Jul 10 18:00:11 devstack cinder-volume[76163]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 18:00:11 devstack cinder-volume[76163]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 18:00:11 devstack cinder-volume[76163]: we strongly recommend against using it for new projects. Jul 10 18:00:11 devstack cinder-volume[76163]: If you are already using Eventlet, we recommend migrating to a different Jul 10 18:00:11 devstack cinder-volume[76163]: framework. For more detail see Jul 10 18:00:11 devstack cinder-volume[76163]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 18:00:11 devstack cinder-volume[76163]: import eventlet # noqa Jul 10 18:00:14 devstack cinder-volume[76163]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76163) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 18:00:14 devstack cinder-volume[76163]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76163) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 18:00:14 devstack cinder-volume[76163]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76163) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 18:00:15 devstack cinder-volume[76163]: INFO dbcounter [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] Registered counter for database cinder Jul 10 18:00:15 devstack cinder-volume[76163]: DEBUG oslo_db.sqlalchemy.engines [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76163) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG dbcounter [-] [76163] Writer thread running {{(pid=76163) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 18:00:16 devstack cinder-volume[76163]: INFO cinder.rpc [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 18:00:16 devstack cinder-volume[76163]: INFO cinder.rpc [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_db.sqlalchemy.engines [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76163) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 18:00:16 devstack cinder-volume[76163]: INFO cinder.volume.manager [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] Determined volume DB was empty at startup. Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG cinder.volume.manager [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76163) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 18:00:16 devstack cinder-volume[76163]: INFO cinder.volume.manager [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 10 18:00:16 devstack cinder-volume[76163]: WARNING stevedore.named [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 18:00:16 devstack cinder-volume[76163]: WARNING castellan.key_manager [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 18:00:16 devstack cinder-volume[76163]: WARNING cinder.keymgr.conf_key_mgr [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG cinder.volume.drivers.lvm [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76163) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_concurrency.processutils [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76163) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_concurrency.processutils [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] CMD "cinder-rtstool verify" returned: 0 in 0.377s {{(pid=76163) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_db.sqlalchemy.engines [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76163) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 18:00:16 devstack cinder-volume[76163]: INFO cinder.rpc [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 10 18:00:16 devstack cinder-volume[76163]: INFO cinder.rpc [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 10 18:00:16 devstack cinder-volume[76163]: WARNING stevedore.named [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 18:00:16 devstack cinder-volume[76163]: WARNING castellan.key_manager [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 18:00:16 devstack cinder-volume[76163]: INFO cinder.volume.manager [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_db.sqlalchemy.engines [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76163) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 18:00:16 devstack cinder-volume[76163]: INFO oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] Starting 1 workers Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] Started child 76325 {{(pid=76163) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] Full set of CONF: {{(pid=76163) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] ******************************************************************************** {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] Configuration options gathered from: {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] ================================================================================ {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] allow_availability_zone_fallback = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] allow_compression_on_image_upload = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] allowed_direct_url_schemes = [] {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] api_rate_limit = True {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] auth_strategy = keystone {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] az_cache_duration = 3600 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_availability_zone = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_host = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_name = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_stats_polling_interval = 60 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backup_api_class = cinder.backup.api.API {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backup_name_template = backup-%s {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backup_use_same_host = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backup_use_temp_snapshot = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] chap_password = **** {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] chap_username = {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cinder_internal_tenant_project_id = 39b1a3f4d3de4517aaeba433c187acb1 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cinder_internal_tenant_user_id = 5ab84e425d134286af7affd91ed35811 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cloned_volume_same_az = True {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cluster = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] compression_format = gzip {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] compute_api_class = cinder.compute.nova.API {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] config_dir = [] {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] config_source = [] {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] control_exchange = openstack {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] debug = True {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] default_availability_zone = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] default_group_type = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] default_volume_type = lvmdriver-1 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] disk_geometry = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] driver_client_cert = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] driver_client_cert_key = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] driver_data_namespace = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] driver_ssl_cert_path = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] driver_ssl_cert_verify = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] driver_use_ssl = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] enable_force_upload = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] enable_new_services = True {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] enable_unsupported_driver = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] enforce_multipath_for_image_xfer = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] filter_function = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] glance_api_insecure = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] glance_api_servers = ['http://192.168.122.225/image'] {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] glance_api_ssl_compression = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] glance_ca_certificates_file = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] glance_catalog_info = image:glance:publicURL {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] glance_certfile = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] glance_keyfile = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76325]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] glance_num_retries = 3 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] glance_request_timeout = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] goodness_function = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] graceful_shutdown_timeout = 5 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] group_api_class = cinder.group.api.API {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] host = devstack {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] image_compress_on_upload = True {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] image_conversion_address_space_limit = 1 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] image_conversion_cpu_limit = 60 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] image_conversion_disable = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] image_upload_use_cinder_backend = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] image_upload_use_internal_tenant = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] image_volume_cache_enabled = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] image_volume_cache_max_count = 0 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] image_volume_cache_max_size_gb = 0 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] init_host_max_objects_retrieval = 0 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] instance_format = [instance: %(uuid)s] {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] iscsi_target_flags = {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] iscsi_write_cache = on {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] iser_helper = tgtadm {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] iser_ip_address = 192.168.122.225 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] iser_port = 3260 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] log_color = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] log_config_append = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] log_dir = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] log_file = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] log_options = True {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] log_rotate_interval = 1 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] log_rotate_interval_type = days {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] log_rotation_type = none {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] max_age = 0 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] max_logfile_count = 30 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76325]: INFO cinder.volume.manager [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 10 18:00:16 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] max_logfile_size_mb = 200 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] max_over_subscription_ratio = 20.0 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] message_reap_interval = 86400 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] message_ttl = 2592000 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] migration_create_volume_timeout_secs = 300 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] monkey_patch = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] monkey_patch_modules = [] {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] my_ip = 192.168.122.225 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] no_snapshot_gb_quota = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] num_iser_scan_tries = 3 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] num_shell_tries = 3 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] num_volume_device_scan_tries = 3 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] nvmeof_conn_info_version = 1 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] nvmet_ns_id = 10 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] nvmet_port_id = 1 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] osapi_max_limit = 1000 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] osapi_volume_ext_list = [] {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] osapi_volume_listen_port = 8776 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] osapi_volume_use_ssl = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] osapi_volume_workers = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] per_volume_size_limit = -1 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] periodic_fuzzy_delay = 60 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] periodic_interval = 60 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] public_endpoint = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] publish_errors = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] quota_backup_gigabytes = 1000 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] quota_backups = 10 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] quota_gigabytes = 1000 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] quota_groups = 10 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] quota_snapshots = 10 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] quota_volumes = 10 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] rate_limit_burst = 0 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] rate_limit_except_level = CRITICAL {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] rate_limit_interval = 0 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] reinit_driver_count = 3 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] replication_device = **** {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] report_discard_supported = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] report_interval = 120 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] reservation_clean_interval = 86400 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] reservation_expire = 86400 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] reserved_image_namespaces = [] {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] reserved_percentage = 0 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] rpc_response_timeout = 120 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] run_external_periodic_tasks = True {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] scst_target_driver = iscsi {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] scst_target_iqn_name = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] service_down_time = 720 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] shell_completion = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] snapshot_name_template = snapshot-%s {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] snapshot_same_host = True {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] split_loggers = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] state_path = /opt/stack/data/cinder {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] storage_availability_zone = nova {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] storage_protocol = iSCSI {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] syslog_log_facility = LOG_USER {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] target_helper = lioadm {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] target_ip_address = 192.168.122.225 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] target_port = 3260 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] target_protocol = iscsi {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] target_secondary_ip_addresses = [] {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] trace_flags = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] transport_url = **** {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] until_refresh = 0 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] use_chap_auth = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] use_default_quota_class = True {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] use_journal = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] use_json = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] use_multipath_for_image_xfer = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] use_stderr = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] use_syslog = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] verify_glance_signatures = enabled {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] volume_api_class = cinder.volume.api.API {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] volume_backend_name = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] volume_clear = zero {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] volume_clear_ionice = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] volume_clear_size = 0 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] volume_copy_bps_limit = 0 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] volume_dd_blocksize = 1M {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] volume_name_template = volume-%s {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] volume_service_inithost_offload = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] volume_usage_audit_period = month {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] zoning_mode = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_concurrency.disable_process_locking = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.053s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.auth_section = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.auth_type = password {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.auth_version = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.cache = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.certfile = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.include_service_catalog = True {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.insecure = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.interface = public {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.keyfile = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.memcache_password = {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.memcache_username = {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.region_name = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.service_type = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.225/identity {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.backend = dogpile.cache.null {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.backend_argument = **** {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.backend_expiration_time = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.config_prefix = cache.oslo {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.debug_cache_backend = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.enable_retry_client = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.enable_socket_keepalive = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.enabled = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.expiration_time = 600 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.hashclient_retry_attempts = 2 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.memcache_dead_retry = 300 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.memcache_pool_maxsize = 10 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.memcache_sasl_enabled = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.password = **** {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.proxies = [] {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.redis_db = 0 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.redis_server = localhost:6379 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.retry_attempts = 2 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.retry_delay = 0.0 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.socket_keepalive_count = 1 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.socket_keepalive_idle = 1 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.socket_keepalive_interval = 1 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.socket_timeout = 1.0 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.tls_allowed_ciphers = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.tls_cafile = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.tls_certfile = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.tls_enabled = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.tls_keyfile = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cache.username = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] coordination.backend_url = **** {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] database.asyncio_connection = **** {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] database.asyncio_slave_connection = **** {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] database.backend = sqlalchemy {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] database.connection = **** {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] database.connection_debug = 0 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] database.connection_parameters = {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] database.connection_recycle_time = 3600 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] database.connection_trace = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] database.db_inc_retry_interval = True {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] database.db_max_retries = 20 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] database.db_max_retry_interval = 10 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] database.db_retry_interval = 1 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] database.max_overflow = 50 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] database.max_pool_size = 5 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] database.max_retries = 10 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] database.mysql_wsrep_sync_wait = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] database.pool_timeout = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] database.retry_interval = 10 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] database.slave_connection = **** {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] database.sqlite_synchronous = True {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] database.synchronous_reader = True {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] database.use_db_reconnect = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] profiler.connection_string = messaging:// {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] profiler.enabled = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] profiler.es_doc_type = notification {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] profiler.es_scroll_size = 10000 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] profiler.es_scroll_time = 2m {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] profiler.filter_error_trace = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] profiler.hmac_keys = **** {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] profiler.sentinel_service_name = mymaster {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] profiler.socket_timeout = 0.1 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] profiler.trace_requests = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] profiler.trace_sqlalchemy = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] profiler_jaeger.process_tags = {} {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] profiler_jaeger.service_name_prefix = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] profiler_otlp.service_name_prefix = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_policy.enforce_new_defaults = True {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_policy.enforce_scope = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_policy.policy_default_rule = default {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_policy.policy_file = policy.yaml {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack sudo[76330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] privsep_osbrick.group = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] privsep_osbrick.helper_command = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:16 devstack sudo[76330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] privsep_osbrick.user = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cinder_sys_admin.group = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cinder_sys_admin.helper_command = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] cinder_sys_admin.user = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] service_user.auth_section = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] service_user.auth_type = password {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] service_user.cafile = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] service_user.certfile = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] service_user.collect_timing = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] service_user.insecure = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] service_user.keyfile = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] service_user.send_service_user_token = True {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] service_user.split_loggers = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] service_user.timeout = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] glance.auth_section = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] glance.auth_type = password {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] glance.certfile = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] glance.collect_timing = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] glance.insecure = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] glance.keyfile = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] glance.region_name = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] glance.split_loggers = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] glance.timeout = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.backend_availability_zone = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.chap_password = **** {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.chap_username = {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.disk_geometry = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.driver_client_cert = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.driver_client_cert_key = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.driver_data_namespace = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.driver_use_ssl = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.extra_capabilities = {} {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.filter_function = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.goodness_function = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.iscsi_target_flags = {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.iscsi_write_cache = on {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.iser_helper = tgtadm {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.iser_ip_address = 192.168.122.225 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.iser_port = 3260 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.lvm_share_target = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.lvm_type = auto {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.num_shell_tries = 3 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.replication_device = **** {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.report_discard_supported = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.reserved_percentage = 0 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.target_helper = tgtadm {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.target_ip_address = 192.168.122.225 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.target_port = 3260 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.target_protocol = iscsi {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.trace_flags = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.unique_fqdn_network = True {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.use_chap_auth = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.volume_backend_name = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.volume_clear = zero {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.volume_clear_ionice = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.volume_clear_size = 0 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_reports.file_event_handler = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_reports.log_dir = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.backend_host = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.chap_password = **** {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.chap_username = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.disk_geometry = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.driver_client_cert = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.extra_capabilities = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.filter_function = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.goodness_function = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.iser_helper = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.iser_ip_address = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.iser_port = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.lvm_share_target = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.lvm_type = auto {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.num_shell_tries = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.replication_device = **** {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.report_discard_supported = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.reserved_percentage = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.scst_target_driver = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.storage_protocol = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.target_helper = lioadm {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.target_ip_address = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.target_port = 3260 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.trace_flags = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.use_chap_auth = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.volume_clear = zero {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.volume_clear_size = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] lvmdriver-1.volumes_dir = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.ssl = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_notifications.driver = [] {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_notifications.retry = -1 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] key_manager.fixed_key = **** {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] barbican.barbican_api_version = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] barbican.barbican_endpoint = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] barbican.barbican_endpoint_type = public {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] barbican.barbican_region_name = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] barbican.cafile = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] barbican.certfile = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] barbican.collect_timing = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] barbican.insecure = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] barbican.keyfile = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] barbican.number_of_retries = 60 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] barbican.retry_delay = 1 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] barbican.send_service_user_token = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] barbican.split_loggers = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] barbican.timeout = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] barbican.verify_ssl = True {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] barbican.verify_ssl_path = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] barbican_service_user.auth_section = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] barbican_service_user.auth_type = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] barbican_service_user.cafile = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] barbican_service_user.certfile = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] barbican_service_user.collect_timing = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] barbican_service_user.insecure = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] barbican_service_user.keyfile = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] barbican_service_user.split_loggers = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] barbican_service_user.timeout = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] vault.approle_role_id = **** {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] vault.approle_secret_id = **** {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] vault.kv_mountpoint = secret {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] vault.kv_path = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] vault.kv_version = 2 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] vault.namespace = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] vault.root_token_id = **** {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] vault.ssl_ca_crt_file = None {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] vault.timeout = 60.0 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] vault.use_ssl = False {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:00:17 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] ******************************************************************************** {{(pid=76163) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 18:00:17 devstack sudo[76330]: pam_unix(sudo:session): session closed for user root Jul 10 18:00:17 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.673s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:00:17 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:00:17 devstack sudo[76430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 18:00:17 devstack sudo[76430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:00:18 devstack sudo[76430]: pam_unix(sudo:session): session closed for user root Jul 10 18:00:18 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.641s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:00:18 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:00:18 devstack cinder-volume[76325]: INFO cinder.brick.local_dev.lvm [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 10 18:00:18 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:00:18 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:00:18 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:00:18 devstack sudo[76659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 18:00:18 devstack sudo[76659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:00:19 devstack sudo[76659]: pam_unix(sudo:session): session closed for user root Jul 10 18:00:19 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.764s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:00:19 devstack cinder-volume[76325]: DEBUG cinder.brick.local_dev.lvm [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76325) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 10 18:00:19 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:00:19 devstack sudo[76894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 18:00:19 devstack sudo[76894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:00:20 devstack sudo[76894]: pam_unix(sudo:session): session closed for user root Jul 10 18:00:20 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.202s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:00:20 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:00:20 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:00:20 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:00:20 devstack sudo[77073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 18:00:20 devstack sudo[77073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:00:21 devstack sudo[77073]: pam_unix(sudo:session): session closed for user root Jul 10 18:00:21 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.716s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:00:21 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:00:21 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:00:21 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:00:21 devstack sudo[77108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 10 18:00:21 devstack sudo[77108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:00:21 devstack sudo[77108]: pam_unix(sudo:session): session closed for user root Jul 10 18:00:21 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.680s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:00:21 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:00:21 devstack sudo[77112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 18:00:21 devstack sudo[77112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:00:22 devstack sudo[77112]: pam_unix(sudo:session): session closed for user root Jul 10 18:00:22 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.924s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:00:22 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:00:22 devstack sudo[77124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 18:00:22 devstack sudo[77124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:00:23 devstack sudo[77124]: pam_unix(sudo:session): session closed for user root Jul 10 18:00:23 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.854s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:00:23 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:00:23 devstack sudo[77129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 18:00:23 devstack sudo[77129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:00:24 devstack sudo[77129]: pam_unix(sudo:session): session closed for user root Jul 10 18:00:24 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.860s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:00:24 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:00:24 devstack sudo[77137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 18:00:24 devstack sudo[77137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:00:25 devstack sudo[77137]: pam_unix(sudo:session): session closed for user root Jul 10 18:00:25 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.662s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:00:25 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:00:25 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:00:25 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:00:25 devstack sudo[77142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 18:00:25 devstack sudo[77142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:00:25 devstack sudo[77142]: pam_unix(sudo:session): session closed for user root Jul 10 18:00:25 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.662s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:00:25 devstack cinder-volume[76325]: INFO cinder.volume.drivers.lvm [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 10 18:00:25 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:00:25 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:00:25 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:00:25 devstack sudo[77177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 18:00:25 devstack sudo[77177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:00:26 devstack sudo[77177]: pam_unix(sudo:session): session closed for user root Jul 10 18:00:26 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.709s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:00:26 devstack cinder-volume[76325]: DEBUG cinder.volume.drivers.lvm [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Updating volume stats {{(pid=76325) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 18:00:26 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:00:26 devstack sudo[77268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 18:00:26 devstack sudo[77268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:00:26 devstack cinder-volume[76163]: DEBUG dbcounter [-] [76163] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76163) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:00:27 devstack sudo[77268]: pam_unix(sudo:session): session closed for user root Jul 10 18:00:27 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.612s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:00:27 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:00:27 devstack sudo[77410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 18:00:27 devstack sudo[77410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:00:27 devstack sudo[77410]: pam_unix(sudo:session): session closed for user root Jul 10 18:00:27 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:00:27 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:00:27 devstack sudo[77413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 18:00:27 devstack sudo[77413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:00:28 devstack sudo[77413]: pam_unix(sudo:session): session closed for user root Jul 10 18:00:28 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.649s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:00:28 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:00:28 devstack sudo[77417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 18:00:28 devstack sudo[77417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:00:28 devstack sudo[77417]: pam_unix(sudo:session): session closed for user root Jul 10 18:00:28 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:00:28 devstack cinder-volume[76325]: INFO cinder.volume.driver [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Driver hasn't implemented _init_vendor_properties() Jul 10 18:00:28 devstack cinder-volume[76325]: DEBUG cinder.volume.driver [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76325) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 18:00:29 devstack cinder-volume[76325]: DEBUG oslo_db.sqlalchemy.engines [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76325) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 18:00:29 devstack cinder-volume[76325]: DEBUG dbcounter [-] [76325] Writer thread running {{(pid=76325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 18:00:29 devstack cinder-volume[76325]: DEBUG cinder.db.api [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Building query based on filter {{(pid=76325) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 18:00:29 devstack cinder-volume[76325]: DEBUG cinder.image.image_utils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76325) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 10 18:00:29 devstack cinder-volume[76325]: INFO cinder.keymgr.migration [None req-b48955be-5306-42f4-907e-705567d785ea None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 18:00:29 devstack cinder-volume[76325]: DEBUG cinder.volume.drivers.lvm [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Updating volume stats {{(pid=76325) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 18:00:29 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:00:29 devstack sudo[77421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 18:00:29 devstack sudo[77421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:00:29 devstack sudo[77421]: pam_unix(sudo:session): session closed for user root Jul 10 18:00:29 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:00:29 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:00:29 devstack sudo[77428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 18:00:29 devstack sudo[77428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:00:30 devstack sudo[77428]: pam_unix(sudo:session): session closed for user root Jul 10 18:00:30 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:00:30 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:00:30 devstack sudo[77431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 18:00:30 devstack sudo[77431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:00:31 devstack sudo[77431]: pam_unix(sudo:session): session closed for user root Jul 10 18:00:31 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.661s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:00:31 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:00:31 devstack sudo[77435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 18:00:31 devstack sudo[77435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:00:31 devstack sudo[77435]: pam_unix(sudo:session): session closed for user root Jul 10 18:00:31 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:00:31 devstack cinder-volume[76325]: DEBUG cinder.manager [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Notifying Schedulers of capabilities ... {{(pid=76325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:00:31 devstack cinder-volume[76325]: INFO cinder.volume.manager [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Driver initialization completed successfully. Jul 10 18:00:31 devstack cinder-volume[76325]: INFO cinder.manager [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Initiating service 2 cleanup Jul 10 18:00:31 devstack cinder-volume[76325]: INFO cinder.manager [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Service 2 cleanup completed. Jul 10 18:00:31 devstack cinder-volume[76325]: DEBUG cinder.service [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Creating RPC server for service cinder-volume {{(pid=76325) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 18:00:31 devstack cinder-volume[76325]: DEBUG cinder.service [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76325) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 18:00:31 devstack cinder-volume[76325]: INFO cinder.volume.manager [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 10 18:00:31 devstack cinder-volume[76325]: DEBUG cinder.volume.drivers.lvm [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Updating volume stats {{(pid=76325) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 18:00:31 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:00:31 devstack sudo[77438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 18:00:31 devstack sudo[77438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:00:32 devstack sudo[77438]: pam_unix(sudo:session): session closed for user root Jul 10 18:00:32 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.819s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:00:32 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:00:32 devstack sudo[77478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 18:00:32 devstack sudo[77478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:00:33 devstack sudo[77478]: pam_unix(sudo:session): session closed for user root Jul 10 18:00:33 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.691s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:00:33 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:00:33 devstack sudo[77481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 18:00:33 devstack sudo[77481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:00:34 devstack sudo[77481]: pam_unix(sudo:session): session closed for user root Jul 10 18:00:34 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.631s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:00:34 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:00:34 devstack sudo[77541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 18:00:34 devstack sudo[77541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:00:34 devstack sudo[77541]: pam_unix(sudo:session): session closed for user root Jul 10 18:00:34 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:00:34 devstack cinder-volume[76325]: INFO cinder.volume.manager [None req-fc1647d1-a1a1-4ee6-98d6-9e0493bd07bc None None] Driver post RPC initialization completed successfully. Jul 10 18:00:41 devstack cinder-volume[76325]: DEBUG dbcounter [-] [76325] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:00:44 devstack cinder-volume[76325]: DEBUG dbcounter [-] [76325] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:01:05 devstack cinder-volume[76325]: DEBUG oslo_service.periodic_task [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] Running periodic task VolumeManager._thread_info {{(pid=76325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:01:05 devstack cinder-volume[76325]: DEBUG cinder.volume.manager [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] thread count: 6 {{(pid=76325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 18:01:05 devstack cinder-volume[76325]: DEBUG cinder.volume.manager [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] thread info: [<_MainThread(MainThread, started 127961612484736)>, , , , , ] {{(pid=76325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 18:02:05 devstack cinder-volume[76325]: DEBUG oslo_service.periodic_task [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:02:05 devstack cinder-volume[76325]: DEBUG cinder.volume.drivers.lvm [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] Updating volume stats {{(pid=76325) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 18:02:05 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:02:05 devstack sudo[80878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 18:02:05 devstack sudo[80878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:02:06 devstack sudo[80878]: pam_unix(sudo:session): session closed for user root Jul 10 18:02:06 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:02:06 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:02:06 devstack sudo[81220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 18:02:06 devstack sudo[81220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:02:06 devstack sudo[81220]: pam_unix(sudo:session): session closed for user root Jul 10 18:02:06 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:02:06 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:02:07 devstack sudo[81569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 18:02:07 devstack sudo[81569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:02:07 devstack sudo[81569]: pam_unix(sudo:session): session closed for user root Jul 10 18:02:07 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.665s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:02:07 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:02:07 devstack sudo[81927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 18:02:07 devstack sudo[81927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:02:08 devstack sudo[81927]: pam_unix(sudo:session): session closed for user root Jul 10 18:02:08 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:02:08 devstack cinder-volume[76325]: DEBUG cinder.manager [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] Notifying Schedulers of capabilities ... {{(pid=76325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:02:08 devstack cinder-volume[76325]: DEBUG oslo_service.periodic_task [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] Running periodic task VolumeManager._thread_info {{(pid=76325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:02:08 devstack cinder-volume[76325]: DEBUG cinder.volume.manager [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] thread count: 6 {{(pid=76325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 18:02:08 devstack cinder-volume[76325]: DEBUG cinder.volume.manager [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] thread info: [<_MainThread(MainThread, started 127961612484736)>, , , , , ] {{(pid=76325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 18:02:44 devstack cinder-volume[76325]: DEBUG dbcounter [-] [76325] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:03:05 devstack cinder-volume[76325]: DEBUG oslo_service.periodic_task [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:03:05 devstack cinder-volume[76325]: DEBUG cinder.volume.drivers.lvm [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] Updating volume stats {{(pid=76325) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 18:03:05 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:03:05 devstack sudo[83725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 18:03:05 devstack sudo[83725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:03:06 devstack sudo[83725]: pam_unix(sudo:session): session closed for user root Jul 10 18:03:06 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:03:06 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:03:06 devstack sudo[83735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 18:03:06 devstack sudo[83735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:03:07 devstack sudo[83735]: pam_unix(sudo:session): session closed for user root Jul 10 18:03:07 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:03:07 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:03:07 devstack sudo[83768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 18:03:07 devstack sudo[83768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:03:07 devstack sudo[83768]: pam_unix(sudo:session): session closed for user root Jul 10 18:03:07 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.653s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:03:07 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:03:07 devstack sudo[83784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 18:03:07 devstack sudo[83784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:03:08 devstack sudo[83784]: pam_unix(sudo:session): session closed for user root Jul 10 18:03:08 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:03:08 devstack cinder-volume[76325]: DEBUG cinder.manager [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] Notifying Schedulers of capabilities ... {{(pid=76325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:03:08 devstack cinder-volume[76325]: DEBUG oslo_service.periodic_task [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] Running periodic task VolumeManager._thread_info {{(pid=76325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:03:08 devstack cinder-volume[76325]: DEBUG cinder.volume.manager [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] thread count: 6 {{(pid=76325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 18:03:08 devstack cinder-volume[76325]: DEBUG cinder.volume.manager [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] thread info: [<_MainThread(MainThread, started 127961612484736)>, , , , , ] {{(pid=76325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 18:04:05 devstack cinder-volume[76325]: DEBUG oslo_service.periodic_task [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:04:05 devstack cinder-volume[76325]: DEBUG cinder.volume.drivers.lvm [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] Updating volume stats {{(pid=76325) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 18:04:05 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:04:05 devstack sudo[85285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 18:04:05 devstack sudo[85285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:04:06 devstack sudo[85285]: pam_unix(sudo:session): session closed for user root Jul 10 18:04:06 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.694s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:04:06 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:04:06 devstack sudo[85298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 18:04:06 devstack sudo[85298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:04:07 devstack sudo[85298]: pam_unix(sudo:session): session closed for user root Jul 10 18:04:07 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:04:07 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:04:07 devstack sudo[85322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 18:04:07 devstack sudo[85322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:04:07 devstack sudo[85322]: pam_unix(sudo:session): session closed for user root Jul 10 18:04:07 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.655s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:04:07 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:04:07 devstack sudo[85349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 18:04:07 devstack sudo[85349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:04:08 devstack sudo[85349]: pam_unix(sudo:session): session closed for user root Jul 10 18:04:08 devstack cinder-volume[76325]: DEBUG oslo_concurrency.processutils [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=76325) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:04:08 devstack cinder-volume[76325]: DEBUG cinder.manager [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] Notifying Schedulers of capabilities ... {{(pid=76325) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:04:08 devstack cinder-volume[76325]: DEBUG oslo_service.periodic_task [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] Running periodic task VolumeManager._thread_info {{(pid=76325) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:04:08 devstack cinder-volume[76325]: DEBUG cinder.volume.manager [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] thread count: 6 {{(pid=76325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 18:04:08 devstack cinder-volume[76325]: DEBUG cinder.volume.manager [None req-0ef1c407-da08-4ab6-86c7-6244be266ed6 None None] thread info: [<_MainThread(MainThread, started 127961612484736)>, , , , , ] {{(pid=76325) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 18:04:44 devstack cinder-volume[76325]: DEBUG dbcounter [-] [76325] Writing DB stats cinder:SELECT=1 {{(pid=76325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:04:44 devstack cinder-volume[76325]: DEBUG dbcounter [-] [76325] Writing DB stats cinder:UPDATE=1 {{(pid=76325) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:04:56 devstack cinder-volume[76163]: INFO oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] Caught SIGTERM, stopping children Jul 10 18:04:56 devstack cinder-volume[76163]: DEBUG oslo_concurrency.lockutils [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] Acquiring lock "singleton_lock" {{(pid=76163) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 18:04:56 devstack cinder-volume[76163]: DEBUG oslo_concurrency.lockutils [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] Acquired lock "singleton_lock" {{(pid=76163) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 18:04:56 devstack cinder-volume[76163]: DEBUG oslo_concurrency.lockutils [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] Releasing lock "singleton_lock" {{(pid=76163) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 18:04:56 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] Stop services. {{(pid=76163) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 10 18:04:56 devstack cinder-volume[76163]: DEBUG oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] Killing children. {{(pid=76163) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 10 18:04:56 devstack cinder-volume[76163]: INFO oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] Waiting on 1 children to exit Jul 10 18:04:56 devstack cinder-volume[76325]: DEBUG oslo_concurrency.lockutils [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] Acquiring lock "singleton_lock" {{(pid=76325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 18:04:56 devstack cinder-volume[76325]: DEBUG oslo_concurrency.lockutils [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] Acquired lock "singleton_lock" {{(pid=76325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 18:04:56 devstack cinder-volume[76325]: DEBUG oslo_concurrency.lockutils [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] Releasing lock "singleton_lock" {{(pid=76325) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 18:04:56 devstack cinder-volume[76325]: WARNING amqp [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 18:04:56 devstack cinder-volume[76325]: WARNING amqp [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 18:04:56 devstack cinder-volume[76163]: INFO oslo_service.backend._eventlet.service [None req-f33b0575-eaae-4f7d-9f5b-34b76dc90470 None None] Child 76325 exited with status 0 Jul 10 18:04:57 devstack cinder-volume[86442]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 18:04:57 devstack cinder-volume[86442]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 18:04:57 devstack cinder-volume[86442]: we strongly recommend against using it for new projects. Jul 10 18:04:57 devstack cinder-volume[86442]: If you are already using Eventlet, we recommend migrating to a different Jul 10 18:04:57 devstack cinder-volume[86442]: framework. For more detail see Jul 10 18:04:57 devstack cinder-volume[86442]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 18:04:57 devstack cinder-volume[86442]: import eventlet # noqa Jul 10 18:04:59 devstack cinder-volume[86442]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86442) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 18:04:59 devstack cinder-volume[86442]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86442) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 18:04:59 devstack cinder-volume[86442]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86442) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 18:04:59 devstack cinder-volume[86442]: INFO dbcounter [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] Registered counter for database cinder Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_db.sqlalchemy.engines [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86442) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG dbcounter [-] [86442] Writer thread running {{(pid=86442) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 18:05:00 devstack cinder-volume[86442]: INFO cinder.rpc [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 18:05:00 devstack cinder-volume[86442]: INFO cinder.rpc [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_db.sqlalchemy.engines [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86442) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 18:05:00 devstack cinder-volume[86442]: INFO cinder.volume.manager [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] Determined volume DB was empty at startup. Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG cinder.volume.manager [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86442) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 18:05:00 devstack cinder-volume[86442]: INFO cinder.volume.manager [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 10 18:05:00 devstack cinder-volume[86442]: WARNING stevedore.named [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 18:05:00 devstack cinder-volume[86442]: WARNING castellan.key_manager [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 18:05:00 devstack cinder-volume[86442]: WARNING cinder.keymgr.conf_key_mgr [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 18:05:00 devstack cinder-volume[86442]: INFO cinder.volume.manager [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_db.sqlalchemy.engines [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86442) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 18:05:00 devstack cinder-volume[86442]: INFO oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] Starting 1 workers Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] Started child 86663 {{(pid=86442) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] Full set of CONF: {{(pid=86442) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] ******************************************************************************** {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] Configuration options gathered from: {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] ================================================================================ {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] allow_availability_zone_fallback = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] allow_compression_on_image_upload = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] allowed_direct_url_schemes = [] {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] api_rate_limit = True {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] auth_strategy = keystone {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_availability_zone = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_host = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_name = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_stats_polling_interval = 60 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backup_api_class = cinder.backup.api.API {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backup_name_template = backup-%s {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backup_use_same_host = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backup_use_temp_snapshot = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] chap_password = **** {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] chap_username = {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cinder_internal_tenant_project_id = 39b1a3f4d3de4517aaeba433c187acb1 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cinder_internal_tenant_user_id = 5ab84e425d134286af7affd91ed35811 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cluster = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] compression_format = gzip {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86663]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] compute_api_class = cinder.compute.nova.API {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] config_dir = [] {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] config_source = [] {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] control_exchange = openstack {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] debug = True {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] default_availability_zone = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] default_group_type = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] default_volume_type = QuobyteHD {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] disk_geometry = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] driver_client_cert = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] driver_client_cert_key = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] driver_data_namespace = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] driver_ssl_cert_path = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] driver_ssl_cert_verify = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] driver_use_ssl = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] enable_new_services = True {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] enable_unsupported_driver = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] enabled_backends = ['QuobyteHD'] {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] enforce_multipath_for_image_xfer = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] filter_function = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] glance_api_insecure = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] glance_api_servers = ['http://192.168.122.225/image'] {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] glance_api_ssl_compression = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] glance_ca_certificates_file = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] glance_catalog_info = image:glance:publicURL {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] glance_certfile = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] glance_keyfile = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] glance_num_retries = 3 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] glance_request_timeout = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] goodness_function = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] graceful_shutdown_timeout = 5 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] group_api_class = cinder.group.api.API {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] host = devstack {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] image_compress_on_upload = True {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] image_conversion_address_space_limit = 1 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] image_conversion_cpu_limit = 60 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] image_conversion_disable = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] image_upload_use_cinder_backend = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] image_upload_use_internal_tenant = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] image_volume_cache_enabled = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] image_volume_cache_max_count = 0 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] image_volume_cache_max_size_gb = 0 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] init_host_max_objects_retrieval = 0 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] instance_format = [instance: %(uuid)s] {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] iscsi_target_flags = {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] iscsi_write_cache = on {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] iser_helper = tgtadm {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] iser_ip_address = 192.168.122.225 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] iser_port = 3260 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] log_color = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] log_config_append = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] log_dir = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] log_file = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] log_options = True {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] log_rotate_interval = 1 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] log_rotate_interval_type = days {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] log_rotation_type = none {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] max_age = 0 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] max_logfile_count = 30 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] max_logfile_size_mb = 200 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] max_over_subscription_ratio = 20.0 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] message_reap_interval = 86400 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] message_ttl = 2592000 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] migration_create_volume_timeout_secs = 300 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] monkey_patch = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] monkey_patch_modules = [] {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] my_ip = 192.168.122.225 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] no_snapshot_gb_quota = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] num_iser_scan_tries = 3 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] num_shell_tries = 3 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] num_volume_device_scan_tries = 3 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] nvmeof_conn_info_version = 1 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] nvmet_ns_id = 10 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] nvmet_port_id = 1 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] osapi_max_limit = 1000 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] osapi_volume_ext_list = [] {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] osapi_volume_listen = 0.0.0.0 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] osapi_volume_listen_port = 8776 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] osapi_volume_use_ssl = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] osapi_volume_workers = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] per_volume_size_limit = -1 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] periodic_fuzzy_delay = 60 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] periodic_interval = 60 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] project_id_regex = [0-9a-f\-]+ {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] public_endpoint = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] publish_errors = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] quota_backup_gigabytes = 1000 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] quota_backups = 10 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] quota_gigabytes = 1000 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] quota_groups = 10 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] quota_snapshots = 10 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] quota_volumes = 10 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] rate_limit_burst = 0 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] rate_limit_except_level = CRITICAL {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] rate_limit_interval = 0 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] reinit_driver_count = 3 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] replication_device = **** {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] report_discard_supported = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] report_interval = 120 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] reservation_clean_interval = 86400 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] reservation_expire = 86400 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] reserved_image_namespaces = [] {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] reserved_percentage = 0 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] rpc_response_timeout = 120 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] run_external_periodic_tasks = True {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] scst_target_driver = iscsi {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] scst_target_iqn_name = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] service_down_time = 720 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] shell_completion = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] snapshot_name_template = snapshot-%s {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] split_loggers = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] state_path = /opt/stack/data/cinder {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] storage_availability_zone = nova {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] storage_protocol = iSCSI {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] syslog_log_facility = LOG_USER {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] target_helper = lioadm {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] target_ip_address = 192.168.122.225 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] target_port = 3260 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] target_protocol = iscsi {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] target_secondary_ip_addresses = [] {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] trace_flags = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] transfer_api_class = cinder.transfer.api.API {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] transport_url = **** {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] until_refresh = 0 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] use_chap_auth = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] use_default_quota_class = True {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] use_journal = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] use_json = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] use_multipath_for_image_xfer = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] use_stderr = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] use_syslog = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] verify_glance_signatures = enabled {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] volume_api_class = cinder.volume.api.API {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] volume_backend_name = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] volume_clear = zero {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] volume_clear_ionice = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] volume_clear_size = 0 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] volume_copy_bps_limit = 0 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] volume_dd_blocksize = 1M {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] volume_name_template = volume-%s {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] volume_service_inithost_offload = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] volume_usage_audit_period = month {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] zoning_mode = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_concurrency.disable_process_locking = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.auth_section = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.auth_type = password {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.auth_version = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.cache = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.certfile = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.delay_auth_decision = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.http_connect_timeout = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.include_service_catalog = True {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.insecure = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.interface = public {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.keyfile = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.memcache_password = {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86663]: INFO cinder.volume.manager [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86663]: DEBUG cinder.volume.drivers.remotefs [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86663) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.memcache_username = {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.region_name = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.service_token_roles_required = True {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.service_type = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.token_cache_time = 300 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.225/identity {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.backend = dogpile.cache.null {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.backend_argument = **** {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.backend_expiration_time = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.config_prefix = cache.oslo {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.debug_cache_backend = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.enable_retry_client = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.enable_socket_keepalive = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.enabled = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.expiration_time = 600 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.hashclient_retry_attempts = 2 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.memcache_dead_retry = 300 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.memcache_pool_maxsize = 10 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.memcache_sasl_enabled = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.password = **** {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.proxies = [] {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.redis_db = 0 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.redis_sentinel_service_name = mymaster {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.redis_server = localhost:6379 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.retry_attempts = 2 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.retry_delay = 0.0 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.socket_keepalive_count = 1 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.socket_keepalive_idle = 1 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.socket_keepalive_interval = 1 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.socket_timeout = 1.0 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.tls_allowed_ciphers = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.tls_cafile = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.tls_certfile = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.tls_enabled = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.tls_keyfile = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cache.username = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] coordination.backend_url = **** {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] database.asyncio_connection = **** {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] database.asyncio_slave_connection = **** {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] database.backend = sqlalchemy {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] database.connection = **** {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] database.connection_debug = 0 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] database.connection_parameters = {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] database.connection_recycle_time = 3600 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] database.connection_trace = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] database.db_inc_retry_interval = True {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] database.db_max_retries = 20 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] database.db_max_retry_interval = 10 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] database.db_retry_interval = 1 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] database.max_overflow = 50 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] database.max_pool_size = 5 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] database.max_retries = 10 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] database.mysql_wsrep_sync_wait = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] database.pool_timeout = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] database.retry_interval = 10 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] database.slave_connection = **** {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] database.sqlite_synchronous = True {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] database.synchronous_reader = True {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] database.use_db_reconnect = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] profiler.connection_string = messaging:// {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] profiler.enabled = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] profiler.es_doc_type = notification {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] profiler.es_scroll_size = 10000 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] profiler.es_scroll_time = 2m {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] profiler.filter_error_trace = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] profiler.hmac_keys = **** {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] profiler.sentinel_service_name = mymaster {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] profiler.socket_timeout = 0.1 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] profiler.trace_requests = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] profiler.trace_sqlalchemy = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] profiler_jaeger.process_tags = {} {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] profiler_jaeger.service_name_prefix = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] profiler_otlp.service_name_prefix = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_policy.enforce_new_defaults = True {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_policy.enforce_scope = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_policy.policy_default_rule = default {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_policy.policy_file = policy.yaml {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_policy.remote_timeout = 60.0 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] privsep_osbrick.group = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] privsep_osbrick.helper_command = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] privsep_osbrick.user = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cinder_sys_admin.group = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cinder_sys_admin.helper_command = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] cinder_sys_admin.user = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] service_user.auth_section = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] service_user.auth_type = password {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] service_user.cafile = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] service_user.certfile = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] service_user.collect_timing = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] service_user.insecure = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] service_user.keyfile = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] service_user.send_service_user_token = True {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] service_user.split_loggers = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] service_user.timeout = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] glance.auth_section = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] glance.auth_type = password {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] glance.certfile = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] glance.collect_timing = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] glance.insecure = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] glance.keyfile = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] glance.region_name = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] glance.split_loggers = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] glance.timeout = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.backend_availability_zone = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.chap_password = **** {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.chap_username = {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.disk_geometry = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.driver_client_cert = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.driver_client_cert_key = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.driver_data_namespace = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.driver_use_ssl = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.enable_unsupported_driver = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.extra_capabilities = {} {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.filter_function = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.goodness_function = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.iscsi_target_flags = {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.iscsi_write_cache = on {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.iser_helper = tgtadm {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.iser_ip_address = 192.168.122.225 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.iser_port = 3260 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.nas_host = {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.nas_login = admin {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.nas_mount_options = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.nas_password = **** {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.nas_private_key = {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.nas_share_path = {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.nas_ssh_port = 22 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.num_shell_tries = 3 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.nvmet_port_id = 1 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.quobyte_client_cfg = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.quobyte_volume_url = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.replication_device = **** {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.report_discard_supported = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.reserved_percentage = 0 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.scst_target_driver = iscsi {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.scst_target_iqn_name = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.storage_protocol = iSCSI {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.target_helper = tgtadm {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.target_ip_address = 192.168.122.225 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.target_port = 3260 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.target_protocol = iscsi {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.trace_flags = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.unique_fqdn_network = True {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.use_chap_auth = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.volume_backend_name = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.volume_clear = zero {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.volume_clear_ionice = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.volume_clear_size = 0 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_reports.file_event_handler = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_reports.log_dir = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.backend_availability_zone = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.backend_host = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.chap_password = **** {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.chap_username = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.chiscsi_conf = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.disk_geometry = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.driver_client_cert = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.driver_client_cert_key = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.driver_data_namespace = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.driver_use_ssl = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.extra_capabilities = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.filter_function = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.goodness_function = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.iscsi_target_flags = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.iscsi_write_cache = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.iser_helper = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.iser_ip_address = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.iser_port = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.iser_target_prefix = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.nas_host = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.nas_login = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.nas_mount_options = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.nas_password = **** {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.nas_private_key = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.nas_share_path = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.nas_ssh_port = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.num_shell_tries = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.nvmet_ns_id = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.nvmet_port_id = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.replication_device = **** {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.report_discard_supported = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.reserved_percentage = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.scst_target_driver = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86663]: DEBUG cinder.volume.drivers.quobyte [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86663) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 10 18:05:00 devstack cinder-volume[86663]: WARNING cinder.volume.drivers.quobyte [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 10 18:05:00 devstack cinder-volume[86663]: WARNING cinder.volume.drivers.quobyte [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.storage_protocol = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.target_helper = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.target_ip_address = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.target_port = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86663]: DEBUG oslo_concurrency.processutils [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Running cmd (subprocess): mount.quobyte {{(pid=86663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.target_prefix = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.target_protocol = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.trace_flags = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.unique_fqdn_network = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.use_chap_auth = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.volume_clear = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.volume_clear_ionice = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.volume_clear_size = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] QuobyteHD.volumes_dir = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.ssl = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.ssl_version = {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_notifications.driver = [] {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_notifications.retry = -1 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] oslo_messaging_notifications.transport_url = **** {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] key_manager.fixed_key = **** {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] barbican.barbican_api_version = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] barbican.barbican_endpoint = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] barbican.barbican_endpoint_type = public {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] barbican.barbican_region_name = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] barbican.cafile = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] barbican.certfile = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] barbican.collect_timing = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] barbican.insecure = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] barbican.keyfile = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] barbican.number_of_retries = 60 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] barbican.retry_delay = 1 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] barbican.send_service_user_token = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] barbican.split_loggers = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] barbican.timeout = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] barbican.verify_ssl = True {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] barbican.verify_ssl_path = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] barbican_service_user.auth_section = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] barbican_service_user.auth_type = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] barbican_service_user.cafile = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] barbican_service_user.certfile = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] barbican_service_user.collect_timing = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] barbican_service_user.insecure = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] barbican_service_user.keyfile = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] barbican_service_user.split_loggers = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] barbican_service_user.timeout = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] vault.approle_role_id = **** {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] vault.approle_secret_id = **** {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] vault.kv_mountpoint = secret {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] vault.kv_path = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] vault.kv_version = 2 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] vault.namespace = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] vault.root_token_id = **** {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] vault.ssl_ca_crt_file = None {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] vault.timeout = 60.0 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] vault.use_ssl = False {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:00 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] ******************************************************************************** {{(pid=86442) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 18:05:01 devstack quobyte-client[86668]: Reading configuration file: /etc/quobyte/client.cfg Jul 10 18:05:01 devstack quobyte-client[86668]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 10 18:05:01 devstack cinder-volume[86663]: DEBUG oslo_concurrency.processutils [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] CMD "mount.quobyte" returned: 1 in 0.088s {{(pid=86663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:05:01 devstack cinder-volume[86663]: DEBUG oslo_concurrency.lockutils [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:05:01 devstack cinder-volume[86663]: DEBUG oslo_concurrency.lockutils [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:05:01 devstack cinder-volume[86663]: DEBUG cinder.volume.drivers.quobyte [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=86663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:05:01 devstack cinder-volume[86663]: INFO cinder.volume.drivers.quobyte [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd ... Jul 10 18:05:01 devstack cinder-volume[86663]: DEBUG oslo_concurrency.processutils [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e -c /etc/quobyte/client-cinder.cfg {{(pid=86663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:05:01 devstack sudo[86669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e -c /etc/quobyte/client-cinder.cfg Jul 10 18:05:01 devstack sudo[86669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:05:01 devstack sudo[86669]: pam_unix(sudo:session): session closed for user root Jul 10 18:05:01 devstack cinder-volume[86663]: DEBUG oslo_concurrency.processutils [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.839s {{(pid=86663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:05:01 devstack cinder-volume[86663]: INFO cinder.volume.drivers.quobyte [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd succeeded Jul 10 18:05:01 devstack cinder-volume[86663]: DEBUG cinder.volume.drivers.quobyte [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=86663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:05:01 devstack cinder-volume[86663]: DEBUG oslo_concurrency.lockutils [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.851s {{(pid=86663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:05:01 devstack cinder-volume[86663]: DEBUG oslo_concurrency.processutils [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=86663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:05:01 devstack sudo[86741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:05:01 devstack sudo[86741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:05:02 devstack sudo[86741]: pam_unix(sudo:session): session closed for user root Jul 10 18:05:02 devstack cinder-volume[86663]: DEBUG oslo_concurrency.processutils [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.643s {{(pid=86663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:05:02 devstack cinder-volume[86663]: INFO cinder.volume.driver [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Driver hasn't implemented _init_vendor_properties() Jul 10 18:05:02 devstack cinder-volume[86663]: DEBUG cinder.volume.driver [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86663) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 18:05:02 devstack cinder-volume[86663]: DEBUG oslo_db.sqlalchemy.engines [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86663) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 18:05:02 devstack cinder-volume[86663]: DEBUG dbcounter [-] [86663] Writer thread running {{(pid=86663) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 18:05:02 devstack cinder-volume[86663]: DEBUG cinder.db.api [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Building query based on filter {{(pid=86663) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 18:05:02 devstack cinder-volume[86663]: DEBUG cinder.image.image_utils [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86663) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 10 18:05:02 devstack cinder-volume[86663]: INFO cinder.keymgr.migration [None req-49f36c9c-6994-4fc3-b15b-c6ff415de0d8 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 18:05:02 devstack cinder-volume[86663]: DEBUG oslo_concurrency.lockutils [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:05:02 devstack cinder-volume[86663]: DEBUG oslo_concurrency.lockutils [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:05:02 devstack cinder-volume[86663]: DEBUG cinder.volume.drivers.quobyte [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=86663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:05:02 devstack cinder-volume[86663]: DEBUG cinder.volume.drivers.quobyte [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=86663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:05:02 devstack cinder-volume[86663]: DEBUG oslo_concurrency.lockutils [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:05:02 devstack cinder-volume[86663]: DEBUG oslo_concurrency.processutils [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=86663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:05:02 devstack sudo[86745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:05:02 devstack sudo[86745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:05:03 devstack sudo[86745]: pam_unix(sudo:session): session closed for user root Jul 10 18:05:03 devstack cinder-volume[86663]: DEBUG oslo_concurrency.processutils [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.658s {{(pid=86663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:05:03 devstack cinder-volume[86663]: DEBUG cinder.manager [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Notifying Schedulers of capabilities ... {{(pid=86663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:05:03 devstack cinder-volume[86663]: INFO cinder.volume.manager [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Driver initialization completed successfully. Jul 10 18:05:03 devstack cinder-volume[86663]: INFO cinder.manager [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Initiating service 3 cleanup Jul 10 18:05:03 devstack cinder-volume[86663]: INFO cinder.manager [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Service 3 cleanup completed. Jul 10 18:05:03 devstack cinder-volume[86663]: DEBUG cinder.service [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Creating RPC server for service cinder-volume {{(pid=86663) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 18:05:03 devstack cinder-volume[86663]: DEBUG cinder.service [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86663) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 18:05:03 devstack cinder-volume[86663]: INFO cinder.volume.manager [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 10 18:05:03 devstack cinder-volume[86663]: DEBUG oslo_concurrency.lockutils [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:05:03 devstack cinder-volume[86663]: DEBUG oslo_concurrency.lockutils [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:05:03 devstack cinder-volume[86663]: DEBUG cinder.volume.drivers.quobyte [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=86663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:05:03 devstack cinder-volume[86663]: DEBUG cinder.volume.drivers.quobyte [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=86663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:05:03 devstack cinder-volume[86663]: DEBUG oslo_concurrency.lockutils [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:05:03 devstack cinder-volume[86663]: DEBUG oslo_concurrency.processutils [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=86663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:05:03 devstack sudo[86763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:05:03 devstack sudo[86763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:05:04 devstack sudo[86763]: pam_unix(sudo:session): session closed for user root Jul 10 18:05:04 devstack cinder-volume[86663]: DEBUG oslo_concurrency.processutils [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.693s {{(pid=86663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:05:04 devstack cinder-volume[86663]: INFO cinder.volume.manager [None req-ee94c399-c320-4df8-9533-85f686ad4a19 None None] Driver post RPC initialization completed successfully. Jul 10 18:05:08 devstack cinder-volume[86663]: DEBUG oslo_concurrency.lockutils [None req-32d4c2aa-2f94-4e49-add2-35bd5b9fa868 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:05:08 devstack cinder-volume[86663]: DEBUG oslo_concurrency.lockutils [None req-32d4c2aa-2f94-4e49-add2-35bd5b9fa868 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:05:08 devstack cinder-volume[86663]: DEBUG cinder.volume.drivers.quobyte [None req-32d4c2aa-2f94-4e49-add2-35bd5b9fa868 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=86663) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:05:08 devstack cinder-volume[86663]: DEBUG cinder.volume.drivers.quobyte [None req-32d4c2aa-2f94-4e49-add2-35bd5b9fa868 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=86663) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:05:08 devstack cinder-volume[86663]: DEBUG oslo_concurrency.lockutils [None req-32d4c2aa-2f94-4e49-add2-35bd5b9fa868 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86663) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:05:08 devstack cinder-volume[86663]: DEBUG oslo_concurrency.processutils [None req-32d4c2aa-2f94-4e49-add2-35bd5b9fa868 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=86663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:05:08 devstack sudo[86959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:05:08 devstack sudo[86959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:05:09 devstack sudo[86959]: pam_unix(sudo:session): session closed for user root Jul 10 18:05:09 devstack cinder-volume[86663]: DEBUG oslo_concurrency.processutils [None req-32d4c2aa-2f94-4e49-add2-35bd5b9fa868 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.638s {{(pid=86663) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:05:09 devstack cinder-volume[86663]: DEBUG cinder.manager [None req-32d4c2aa-2f94-4e49-add2-35bd5b9fa868 None None] Notifying Schedulers of capabilities ... {{(pid=86663) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:05:10 devstack cinder-volume[86442]: INFO oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] Caught SIGTERM, stopping children Jul 10 18:05:10 devstack cinder-volume[86442]: DEBUG oslo_concurrency.lockutils [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] Acquiring lock "singleton_lock" {{(pid=86442) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 18:05:10 devstack cinder-volume[86442]: DEBUG oslo_concurrency.lockutils [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] Acquired lock "singleton_lock" {{(pid=86442) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 18:05:10 devstack cinder-volume[86442]: DEBUG oslo_concurrency.lockutils [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] Releasing lock "singleton_lock" {{(pid=86442) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 18:05:10 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] Stop services. {{(pid=86442) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 10 18:05:10 devstack cinder-volume[86442]: DEBUG oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] Killing children. {{(pid=86442) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 10 18:05:10 devstack cinder-volume[86442]: INFO oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] Waiting on 1 children to exit Jul 10 18:05:11 devstack cinder-volume[86663]: DEBUG oslo_concurrency.lockutils [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] Acquiring lock "singleton_lock" {{(pid=86663) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 18:05:11 devstack cinder-volume[86663]: DEBUG oslo_concurrency.lockutils [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] Acquired lock "singleton_lock" {{(pid=86663) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 18:05:11 devstack cinder-volume[86663]: DEBUG oslo_concurrency.lockutils [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] Releasing lock "singleton_lock" {{(pid=86663) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 18:05:11 devstack cinder-volume[86663]: WARNING amqp [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 18:05:11 devstack cinder-volume[86663]: WARNING amqp [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 18:05:11 devstack cinder-volume[86442]: INFO oslo_service.backend._eventlet.service [None req-b8a7cceb-9f2a-47f3-abc0-b2fb00416b1b None None] Child 86663 exited with status 0 Jul 10 18:05:12 devstack cinder-volume[87098]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 18:05:12 devstack cinder-volume[87098]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 18:05:12 devstack cinder-volume[87098]: we strongly recommend against using it for new projects. Jul 10 18:05:12 devstack cinder-volume[87098]: If you are already using Eventlet, we recommend migrating to a different Jul 10 18:05:12 devstack cinder-volume[87098]: framework. For more detail see Jul 10 18:05:12 devstack cinder-volume[87098]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 18:05:12 devstack cinder-volume[87098]: import eventlet # noqa Jul 10 18:05:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87098) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 18:05:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87098) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 18:05:15 devstack cinder-volume[87098]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87098) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 18:05:16 devstack cinder-volume[87098]: INFO dbcounter [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] Registered counter for database cinder Jul 10 18:05:16 devstack cinder-volume[87098]: DEBUG oslo_db.sqlalchemy.engines [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87098) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 18:05:16 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writer thread running {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 18:05:16 devstack cinder-volume[87098]: INFO cinder.rpc [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 18:05:16 devstack cinder-volume[87098]: INFO cinder.rpc [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_db.sqlalchemy.engines [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87098) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 18:05:17 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] Determined volume DB was empty at startup. Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG cinder.volume.manager [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87098) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 18:05:17 devstack cinder-volume[87098]: WARNING stevedore.named [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 18:05:17 devstack cinder-volume[87098]: WARNING castellan.key_manager [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 18:05:17 devstack cinder-volume[87098]: WARNING cinder.keymgr.conf_key_mgr [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 18:05:17 devstack cinder-volume[87098]: INFO cinder.volume.manager [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_db.sqlalchemy.engines [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87098) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 18:05:17 devstack cinder-volume[87098]: INFO oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] Starting 1 workers Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] Started child 87399 {{(pid=87098) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] Full set of CONF: {{(pid=87098) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] ******************************************************************************** {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] Configuration options gathered from: {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] ================================================================================ {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] allow_availability_zone_fallback = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] allow_compression_on_image_upload = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] allowed_direct_url_schemes = [] {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] api_rate_limit = True {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] auth_strategy = keystone {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_availability_zone = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_host = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_name = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_stats_polling_interval = 60 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backup_api_class = cinder.backup.api.API {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87399]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backup_name_template = backup-%s {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backup_use_same_host = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backup_use_temp_snapshot = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] chap_password = **** {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] chap_username = {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cinder_internal_tenant_project_id = 39b1a3f4d3de4517aaeba433c187acb1 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cinder_internal_tenant_user_id = 5ab84e425d134286af7affd91ed35811 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cluster = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] compression_format = gzip {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] compute_api_class = cinder.compute.nova.API {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] config_dir = [] {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] config_source = [] {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] control_exchange = openstack {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] debug = True {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] default_availability_zone = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] default_group_type = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] default_volume_type = QuobyteHD {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] disk_geometry = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] driver_client_cert = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] driver_client_cert_key = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] driver_data_namespace = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] driver_ssl_cert_path = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] driver_ssl_cert_verify = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] driver_use_ssl = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] enable_new_services = True {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] enable_unsupported_driver = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] enabled_backends = ['QuobyteHD'] {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] enforce_multipath_for_image_xfer = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] filter_function = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] glance_api_insecure = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] glance_api_servers = ['http://192.168.122.225/image'] {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] glance_api_ssl_compression = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] glance_ca_certificates_file = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] glance_catalog_info = image:glance:publicURL {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] glance_certfile = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] glance_keyfile = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] glance_num_retries = 3 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] glance_request_timeout = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] goodness_function = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] graceful_shutdown_timeout = 5 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] group_api_class = cinder.group.api.API {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] host = devstack {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] image_compress_on_upload = True {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] image_conversion_address_space_limit = 1 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] image_conversion_cpu_limit = 60 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] image_conversion_disable = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] image_upload_use_cinder_backend = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] image_upload_use_internal_tenant = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] image_volume_cache_enabled = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] image_volume_cache_max_count = 0 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] image_volume_cache_max_size_gb = 0 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] init_host_max_objects_retrieval = 0 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] instance_format = [instance: %(uuid)s] {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] iscsi_target_flags = {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] iscsi_write_cache = on {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] iser_helper = tgtadm {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] iser_ip_address = 192.168.122.225 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] iser_port = 3260 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] log_color = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] log_config_append = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] log_dir = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] log_file = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] log_options = True {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] log_rotate_interval = 1 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] log_rotate_interval_type = days {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] log_rotation_type = none {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] max_age = 0 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] max_logfile_count = 30 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] max_logfile_size_mb = 200 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] max_over_subscription_ratio = 20.0 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] message_reap_interval = 86400 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] message_ttl = 2592000 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] migration_create_volume_timeout_secs = 300 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] monkey_patch = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] monkey_patch_modules = [] {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] my_ip = 192.168.122.225 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] no_snapshot_gb_quota = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] num_iser_scan_tries = 3 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] num_shell_tries = 3 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] num_volume_device_scan_tries = 3 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] nvmeof_conn_info_version = 1 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] nvmet_ns_id = 10 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] nvmet_port_id = 1 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] osapi_max_limit = 1000 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] osapi_volume_ext_list = [] {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] osapi_volume_listen_port = 8776 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] osapi_volume_use_ssl = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] osapi_volume_workers = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] per_volume_size_limit = -1 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] periodic_fuzzy_delay = 60 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] periodic_interval = 60 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] public_endpoint = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] publish_errors = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] quota_backup_gigabytes = 1000 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] quota_backups = 10 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] quota_gigabytes = 1000 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] quota_groups = 10 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] quota_snapshots = 10 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] quota_volumes = 10 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] rate_limit_burst = 0 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] rate_limit_except_level = CRITICAL {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] rate_limit_interval = 0 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] reinit_driver_count = 3 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] replication_device = **** {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] report_discard_supported = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] report_interval = 120 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] reservation_clean_interval = 86400 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] reservation_expire = 86400 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] reserved_image_namespaces = [] {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] reserved_percentage = 0 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] rpc_response_timeout = 120 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] run_external_periodic_tasks = True {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] scst_target_driver = iscsi {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] scst_target_iqn_name = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] service_down_time = 720 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] shell_completion = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] snapshot_name_template = snapshot-%s {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] split_loggers = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] state_path = /opt/stack/data/cinder {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] storage_availability_zone = nova {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] storage_protocol = iSCSI {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] syslog_log_facility = LOG_USER {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 10 18:05:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87399) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] target_helper = lioadm {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] target_ip_address = 192.168.122.225 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] target_port = 3260 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] target_protocol = iscsi {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] target_secondary_ip_addresses = [] {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] trace_flags = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] transport_url = **** {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] until_refresh = 0 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] use_chap_auth = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] use_default_quota_class = True {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] use_journal = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] use_json = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] use_multipath_for_image_xfer = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] use_stderr = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] use_syslog = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] verify_glance_signatures = enabled {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] volume_api_class = cinder.volume.api.API {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] volume_backend_name = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] volume_clear = zero {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] volume_clear_ionice = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] volume_clear_size = 0 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] volume_copy_bps_limit = 0 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] volume_dd_blocksize = 1M {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] volume_name_template = volume-%s {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] volume_service_inithost_offload = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] volume_usage_audit_period = month {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] zoning_mode = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_concurrency.disable_process_locking = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.auth_section = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.auth_type = password {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.auth_version = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.cache = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.certfile = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.include_service_catalog = True {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.insecure = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.interface = public {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.keyfile = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.memcache_password = {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.memcache_username = {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.region_name = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.service_type = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.225/identity {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.backend = dogpile.cache.null {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.backend_argument = **** {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.backend_expiration_time = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.config_prefix = cache.oslo {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.debug_cache_backend = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.enable_retry_client = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.enable_socket_keepalive = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.enabled = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.expiration_time = 600 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.hashclient_retry_attempts = 2 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.memcache_dead_retry = 300 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.memcache_pool_maxsize = 10 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.memcache_sasl_enabled = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.password = **** {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.proxies = [] {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.redis_db = 0 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.redis_server = localhost:6379 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.retry_attempts = 2 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.retry_delay = 0.0 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.socket_keepalive_count = 1 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.socket_keepalive_idle = 1 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.socket_keepalive_interval = 1 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.socket_timeout = 1.0 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.tls_allowed_ciphers = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.tls_cafile = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.tls_certfile = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.tls_enabled = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.tls_keyfile = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cache.username = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] coordination.backend_url = **** {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] database.asyncio_connection = **** {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] database.asyncio_slave_connection = **** {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] database.backend = sqlalchemy {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] database.connection = **** {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] database.connection_debug = 0 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] database.connection_parameters = {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] database.connection_recycle_time = 3600 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] database.connection_trace = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] database.db_inc_retry_interval = True {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] database.db_max_retries = 20 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] database.db_max_retry_interval = 10 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] database.db_retry_interval = 1 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] database.max_overflow = 50 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] database.max_pool_size = 5 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] database.max_retries = 10 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] database.mysql_wsrep_sync_wait = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] database.pool_timeout = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] database.retry_interval = 10 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] database.slave_connection = **** {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] database.sqlite_synchronous = True {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] database.synchronous_reader = True {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] database.use_db_reconnect = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87399) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 10 18:05:17 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.quobyte [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 10 18:05:17 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.quobyte [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 10 18:05:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] Running cmd (subprocess): mount.quobyte {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] profiler.connection_string = messaging:// {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] profiler.enabled = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] profiler.es_doc_type = notification {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] profiler.es_scroll_size = 10000 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] profiler.es_scroll_time = 2m {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] profiler.filter_error_trace = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] profiler.hmac_keys = **** {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] profiler.sentinel_service_name = mymaster {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] profiler.socket_timeout = 0.1 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] profiler.trace_requests = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] profiler.trace_sqlalchemy = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] profiler_jaeger.process_tags = {} {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] profiler_jaeger.service_name_prefix = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] profiler_otlp.service_name_prefix = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_policy.enforce_new_defaults = True {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_policy.enforce_scope = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_policy.policy_default_rule = default {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_policy.policy_file = policy.yaml {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] privsep_osbrick.group = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] privsep_osbrick.helper_command = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] privsep_osbrick.user = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cinder_sys_admin.group = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cinder_sys_admin.helper_command = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] cinder_sys_admin.user = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] service_user.auth_section = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] service_user.auth_type = password {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] service_user.cafile = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] service_user.certfile = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] service_user.collect_timing = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] service_user.insecure = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] service_user.keyfile = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] service_user.send_service_user_token = True {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] service_user.split_loggers = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] service_user.timeout = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] glance.auth_section = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] glance.auth_type = password {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] glance.certfile = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] glance.collect_timing = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] glance.insecure = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] glance.keyfile = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] glance.region_name = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] glance.split_loggers = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] glance.timeout = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.backend_availability_zone = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.chap_password = **** {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.chap_username = {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.disk_geometry = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.driver_client_cert = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.driver_client_cert_key = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.driver_data_namespace = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.driver_use_ssl = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.extra_capabilities = {} {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.filter_function = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.goodness_function = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.iscsi_target_flags = {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.iscsi_write_cache = on {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.iser_helper = tgtadm {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.iser_ip_address = 192.168.122.225 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.iser_port = 3260 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.nas_host = {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.nas_login = admin {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.nas_mount_options = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.nas_password = **** {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.nas_private_key = {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.nas_share_path = {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.num_shell_tries = 3 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] CMD "mount.quobyte" returned: 1 in 0.083s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:05:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:05:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:05:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.quobyte_volume_url = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.replication_device = **** {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.report_discard_supported = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.reserved_percentage = 0 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:05:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:05:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.target_helper = tgtadm {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.target_ip_address = 192.168.122.225 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.target_port = 3260 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.target_protocol = iscsi {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.trace_flags = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.unique_fqdn_network = True {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack sudo[87405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.use_chap_auth = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.volume_backend_name = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.volume_clear = zero {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.volume_clear_ionice = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.volume_clear_size = 0 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack sudo[87405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_reports.file_event_handler = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_reports.log_dir = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.backend_availability_zone = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.backend_host = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.chap_password = **** {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.chap_username = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.chiscsi_conf = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.disk_geometry = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.driver_client_cert = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.driver_data_namespace = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.driver_use_ssl = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.extra_capabilities = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.filter_function = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.goodness_function = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.iser_helper = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.iser_ip_address = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.iser_port = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.iser_target_prefix = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.nas_host = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.nas_login = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.nas_mount_options = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.nas_password = **** {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.nas_private_key = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:17 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.nas_share_path = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.nas_ssh_port = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.num_shell_tries = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.nvmet_port_id = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.replication_device = **** {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.report_discard_supported = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.reserved_percentage = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.scst_target_driver = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.storage_protocol = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.target_helper = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.target_ip_address = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.target_port = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.target_prefix = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.target_protocol = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.trace_flags = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.use_chap_auth = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.volume_clear = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.volume_clear_size = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] QuobyteHD.volumes_dir = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.ssl = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_notifications.driver = [] {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_notifications.retry = -1 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] key_manager.fixed_key = **** {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] barbican.barbican_api_version = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] barbican.barbican_endpoint = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] barbican.barbican_endpoint_type = public {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] barbican.barbican_region_name = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] barbican.cafile = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] barbican.certfile = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] barbican.collect_timing = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] barbican.insecure = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] barbican.keyfile = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] barbican.number_of_retries = 60 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] barbican.retry_delay = 1 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] barbican.send_service_user_token = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] barbican.split_loggers = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] barbican.timeout = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] barbican.verify_ssl = True {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] barbican.verify_ssl_path = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] barbican_service_user.auth_section = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] barbican_service_user.auth_type = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] barbican_service_user.cafile = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] barbican_service_user.certfile = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] barbican_service_user.collect_timing = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] barbican_service_user.insecure = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] barbican_service_user.keyfile = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] barbican_service_user.split_loggers = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] barbican_service_user.timeout = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] vault.approle_role_id = **** {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] vault.approle_secret_id = **** {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] vault.kv_mountpoint = secret {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] vault.kv_path = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] vault.kv_version = 2 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] vault.namespace = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] vault.root_token_id = **** {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] vault.ssl_ca_crt_file = None {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] vault.timeout = 60.0 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] vault.use_ssl = False {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 18:05:18 devstack cinder-volume[87098]: DEBUG oslo_service.backend._eventlet.service [None req-ccc98e3a-20e5-4da5-9f8b-73b42cc34133 None None] ******************************************************************************** {{(pid=87098) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 18:05:18 devstack sudo[87405]: pam_unix(sudo:session): session closed for user root Jul 10 18:05:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.792s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:05:18 devstack cinder-volume[87399]: INFO cinder.volume.driver [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] Driver hasn't implemented _init_vendor_properties() Jul 10 18:05:18 devstack cinder-volume[87399]: DEBUG cinder.volume.driver [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87399) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 18:05:18 devstack cinder-volume[87399]: DEBUG oslo_db.sqlalchemy.engines [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87399) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 18:05:18 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writer thread running {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 18:05:18 devstack cinder-volume[87399]: DEBUG cinder.db.api [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] Building query based on filter {{(pid=87399) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 18:05:18 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87399) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 10 18:05:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:05:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:05:18 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:05:18 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:05:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:05:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:05:18 devstack cinder-volume[87399]: INFO cinder.keymgr.migration [None req-1cfece7f-975d-4ba6-8185-7b12588aa542 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 18:05:18 devstack sudo[87411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:05:18 devstack sudo[87411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:05:19 devstack sudo[87411]: pam_unix(sudo:session): session closed for user root Jul 10 18:05:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.654s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:05:19 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:05:19 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] Driver initialization completed successfully. Jul 10 18:05:19 devstack cinder-volume[87399]: INFO cinder.manager [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] Initiating service 3 cleanup Jul 10 18:05:19 devstack cinder-volume[87399]: INFO cinder.manager [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] Service 3 cleanup completed. Jul 10 18:05:19 devstack cinder-volume[87399]: DEBUG cinder.service [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] Creating RPC server for service cinder-volume {{(pid=87399) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 18:05:19 devstack cinder-volume[87399]: DEBUG cinder.service [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87399) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 18:05:19 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 10 18:05:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:05:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:05:19 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:05:19 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:05:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:05:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:05:19 devstack sudo[87415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:05:19 devstack sudo[87415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:05:20 devstack sudo[87415]: pam_unix(sudo:session): session closed for user root Jul 10 18:05:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.639s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:05:20 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-908096be-86a5-4ffb-9eb9-c5c9f02af454 None None] Driver post RPC initialization completed successfully. Jul 10 18:05:27 devstack cinder-volume[87098]: DEBUG dbcounter [-] [87098] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87098) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:05:29 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:05:30 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=2 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:05:57 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager._thread_info {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:05:57 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread count: 6 {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 18:05:57 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread info: [<_MainThread(MainThread, started 139757428633728)>, , , , , ] {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 18:06:19 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:06:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] Flow 'volume_create_manager' (b126aece-2914-4584-adf5-782375a8549d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:06:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49149c5e-640a-40c5-9420-a6304c3d10a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:06:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49149c5e-640a-40c5-9420-a6304c3d10a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-980944874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3531327b-9ea1-42ef-8e7e-d8e4e8ccfda6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48568902a05e40ee9c1260b15228729a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:06:20Z,use_quota=True,user_id='0a6a5ec64be8448da66759de0fce41ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:06:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a144a58-2552-4e8d-bba8-776d8d5507f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:06:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a144a58-2552-4e8d-bba8-776d8d5507f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:06:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cc5bbf0-5488-4965-8d0b-ee664aa361dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:06:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cc5bbf0-5488-4965-8d0b-ee664aa361dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3531327b-9ea1-42ef-8e7e-d8e4e8ccfda6', 'volume_name': 'volume-3531327b-9ea1-42ef-8e7e-d8e4e8ccfda6', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:06:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (040168cb-8675-43cd-8b94-5d74f693e37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:06:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (040168cb-8675-43cd-8b94-5d74f693e37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:06:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ba9505-f1ec-4abd-a4a0-e5a8638d8736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:06:20 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] Volume 3531327b-9ea1-42ef-8e7e-d8e4e8ccfda6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3531327b-9ea1-42ef-8e7e-d8e4e8ccfda6', 'volume_size': 1} Jul 10 18:06:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:06:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:06:20 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-980944874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3531327b-9ea1-42ef-8e7e-d8e4e8ccfda6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48568902a05e40ee9c1260b15228729a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:06:20Z,use_quota=True,user_id='0a6a5ec64be8448da66759de0fce41ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:06:20 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] Creating volume 3531327b-9ea1-42ef-8e7e-d8e4e8ccfda6 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:06:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:06:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:06:20 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:06:20 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:06:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:06:20 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:06:20 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:06:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3531327b-9ea1-42ef-8e7e-d8e4e8ccfda6 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:06:20 devstack sudo[87624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3531327b-9ea1-42ef-8e7e-d8e4e8ccfda6 1073741824 Jul 10 18:06:20 devstack sudo[87624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:06:21 devstack sudo[87624]: pam_unix(sudo:session): session closed for user root Jul 10 18:06:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3531327b-9ea1-42ef-8e7e-d8e4e8ccfda6 1073741824" returned: 0 in 1.078s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:06:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3531327b-9ea1-42ef-8e7e-d8e4e8ccfda6 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:06:21 devstack sudo[87942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3531327b-9ea1-42ef-8e7e-d8e4e8ccfda6 Jul 10 18:06:21 devstack sudo[87942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:06:21 devstack sudo[87942]: pam_unix(sudo:session): session closed for user root Jul 10 18:06:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3531327b-9ea1-42ef-8e7e-d8e4e8ccfda6" returned: 0 in 0.702s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:06:21 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:06:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.855s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:06:21 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ba9505-f1ec-4abd-a4a0-e5a8638d8736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3531327b-9ea1-42ef-8e7e-d8e4e8ccfda6', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:06:21 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4bc1c01-1c82-4a28-8457-6e80e364eb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:06:21 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] Volume volume-3531327b-9ea1-42ef-8e7e-d8e4e8ccfda6 (3531327b-9ea1-42ef-8e7e-d8e4e8ccfda6): created successfully Jul 10 18:06:21 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4bc1c01-1c82-4a28-8457-6e80e364eb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:06:21 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] Flow 'volume_create_manager' (b126aece-2914-4584-adf5-782375a8549d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:06:22 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-50237e71-3670-40cd-9101-9f201d23fd84 tempest-TaggedAttachmentsTest-724296020 None] Created volume successfully. Jul 10 18:06:31 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:INSERT=1 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:06:32 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:06:32 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:06:32 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] Flow 'volume_create_manager' (5ea5954c-0e91-40f8-9553-fd221bfe7b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:06:32 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1d06d32-5dc7-4e87-85ed-597b7044cbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:06:32 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1d06d32-5dc7-4e87-85ed-597b7044cbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2075318006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c594c39-4904-4199-9b1f-1e1b94eff7eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0baf3fadf4024249a4e78f1730513dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:06:32Z,use_quota=True,user_id='193a7f0905594a19a689940038cdd93e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:06:32 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d7f972-a7ab-4cc7-a4c9-8eb59ef71b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:06:32 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d7f972-a7ab-4cc7-a4c9-8eb59ef71b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:06:32 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1de18e4f-1c4e-4418-ba55-c8aadbae8fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:06:32 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1de18e4f-1c4e-4418-ba55-c8aadbae8fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c594c39-4904-4199-9b1f-1e1b94eff7eb', 'volume_name': 'volume-4c594c39-4904-4199-9b1f-1e1b94eff7eb', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:06:32 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e7b769-45cc-493b-97ba-dc304b2b8839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:06:32 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e7b769-45cc-493b-97ba-dc304b2b8839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:06:32 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ccdb1b-c545-45f3-bf78-7f2d55a0cb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:06:32 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] Volume 4c594c39-4904-4199-9b1f-1e1b94eff7eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c594c39-4904-4199-9b1f-1e1b94eff7eb', 'volume_size': 1} Jul 10 18:06:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:06:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:06:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2075318006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c594c39-4904-4199-9b1f-1e1b94eff7eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0baf3fadf4024249a4e78f1730513dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:06:32Z,use_quota=True,user_id='193a7f0905594a19a689940038cdd93e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:06:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] Creating volume 4c594c39-4904-4199-9b1f-1e1b94eff7eb {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:06:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:06:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:06:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:06:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:06:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:06:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:06:32 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:06:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4c594c39-4904-4199-9b1f-1e1b94eff7eb 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:06:32 devstack sudo[88073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4c594c39-4904-4199-9b1f-1e1b94eff7eb 1073741824 Jul 10 18:06:32 devstack sudo[88073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:06:33 devstack sudo[88073]: pam_unix(sudo:session): session closed for user root Jul 10 18:06:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4c594c39-4904-4199-9b1f-1e1b94eff7eb 1073741824" returned: 0 in 1.342s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:06:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4c594c39-4904-4199-9b1f-1e1b94eff7eb {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:06:33 devstack sudo[88110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4c594c39-4904-4199-9b1f-1e1b94eff7eb Jul 10 18:06:33 devstack sudo[88110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:06:35 devstack sudo[88110]: pam_unix(sudo:session): session closed for user root Jul 10 18:06:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4c594c39-4904-4199-9b1f-1e1b94eff7eb" returned: 0 in 1.589s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:06:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] <== create_volume: return (2996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:06:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.999s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:06:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ccdb1b-c545-45f3-bf78-7f2d55a0cb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c594c39-4904-4199-9b1f-1e1b94eff7eb', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:06:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abb56375-e631-41ef-b30c-1c7c94c9e48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:06:35 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] Volume volume-4c594c39-4904-4199-9b1f-1e1b94eff7eb (4c594c39-4904-4199-9b1f-1e1b94eff7eb): created successfully Jul 10 18:06:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abb56375-e631-41ef-b30c-1c7c94c9e48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:06:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] Flow 'volume_create_manager' (5ea5954c-0e91-40f8-9553-fd221bfe7b3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:06:35 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-8182b06c-0d9e-408a-9ffd-b3146819ed4d tempest-DeleteServersTestJSON-915525219 None] Created volume successfully. Jul 10 18:06:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-71e67e16-717f-4926-8425-7a5b02cb93db tempest-BackendsCapabilitiesAdminTestsJSON-765961948 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87399) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 10 18:06:43 devstack cinder-volume[87399]: WARNING py.warnings [req-1437bcde-2518-4b4c-9c3b-c231e91aec57 req-78ab86eb-824f-4ffa-91bd-a91df7c59c0c tempest-DeleteServersTestJSON-915525219 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 10 18:06:43 devstack cinder-volume[87399]: .first() Jul 10 18:06:43 devstack cinder-volume[87399]: Jul 10 18:06:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-1437bcde-2518-4b4c-9c3b-c231e91aec57 req-78ab86eb-824f-4ffa-91bd-a91df7c59c0c tempest-DeleteServersTestJSON-915525219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:06:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-1437bcde-2518-4b4c-9c3b-c231e91aec57 req-78ab86eb-824f-4ffa-91bd-a91df7c59c0c tempest-DeleteServersTestJSON-915525219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:06:43 devstack cinder-volume[87399]: INFO oslo.privsep.daemon [req-1437bcde-2518-4b4c-9c3b-c231e91aec57 req-78ab86eb-824f-4ffa-91bd-a91df7c59c0c tempest-DeleteServersTestJSON-915525219 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpm69_1rlf/privsep.sock'] Jul 10 18:06:43 devstack sudo[88292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpm69_1rlf/privsep.sock Jul 10 18:06:43 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:06:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4015702f-adb8-4dfb-b74f-8f7e7673438b tempest-BackendsCapabilitiesAdminTestsJSON-765961948 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87399) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 10 18:06:44 devstack cinder-volume[87399]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 10 18:06:44 devstack cinder-volume[87399]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 18:06:44 devstack cinder-volume[87399]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 10 18:06:44 devstack cinder-volume[87399]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 18:06:44 devstack cinder-volume[87399]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 10 18:06:44 devstack cinder-volume[87399]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 10 18:06:44 devstack cinder-volume[87399]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 18:06:44 devstack cinder-volume[87399]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 18:06:44 devstack cinder-volume[87399]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 10 18:06:45 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:06:45 devstack cinder-volume[87399]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 10 18:06:45 devstack cinder-volume[87399]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 18:06:45 devstack cinder-volume[87399]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 10 18:06:45 devstack cinder-volume[87399]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 18:06:45 devstack cinder-volume[87399]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 10 18:06:45 devstack cinder-volume[87399]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 10 18:06:45 devstack cinder-volume[87399]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 18:06:45 devstack cinder-volume[87399]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 18:06:45 devstack cinder-volume[87399]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 10 18:06:46 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root Jul 10 18:06:46 devstack cinder-volume[87399]: INFO oslo.privsep.daemon [req-1437bcde-2518-4b4c-9c3b-c231e91aec57 req-78ab86eb-824f-4ffa-91bd-a91df7c59c0c tempest-DeleteServersTestJSON-915525219 None] Spawned new privsep daemon via rootwrap Jul 10 18:06:46 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [req-1437bcde-2518-4b4c-9c3b-c231e91aec57 req-78ab86eb-824f-4ffa-91bd-a91df7c59c0c tempest-DeleteServersTestJSON-915525219 None] Accepted privsep connection to /tmp/tmpm69_1rlf/privsep.sock {{(pid=87399) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 10 18:06:46 devstack cinder-volume[87399]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 10 18:06:46 devstack cinder-volume[87399]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 10 18:06:46 devstack cinder-volume[87399]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 10 18:06:46 devstack cinder-volume[87399]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88393 Jul 10 18:06:46 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42ea3e1-353f-493c-8a04-80a7eb20f7aa]: (2,) {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:06:46 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4d8772-759e-4e90-8ca2-629f997575e4]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:06:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-1437bcde-2518-4b4c-9c3b-c231e91aec57 req-78ab86eb-824f-4ffa-91bd-a91df7c59c0c tempest-DeleteServersTestJSON-915525219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4c594c39-4904-4199-9b1f-1e1b94eff7eb {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:06:46 devstack sudo[88397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4c594c39-4904-4199-9b1f-1e1b94eff7eb Jul 10 18:06:46 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:06:47 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root Jul 10 18:06:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-1437bcde-2518-4b4c-9c3b-c231e91aec57 req-78ab86eb-824f-4ffa-91bd-a91df7c59c0c tempest-DeleteServersTestJSON-915525219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4c594c39-4904-4199-9b1f-1e1b94eff7eb" returned: 0 in 1.206s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:06:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-1437bcde-2518-4b4c-9c3b-c231e91aec57 req-78ab86eb-824f-4ffa-91bd-a91df7c59c0c tempest-DeleteServersTestJSON-915525219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.718s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:06:47 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-1437bcde-2518-4b4c-9c3b-c231e91aec57 req-78ab86eb-824f-4ffa-91bd-a91df7c59c0c tempest-DeleteServersTestJSON-915525219 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd', 'name': 'volume-4c594c39-4904-4199-9b1f-1e1b94eff7eb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '13da6d16-ce6a-45e7-8868-3cc1e57f22b1', 'enforce_multipath': True} {{(pid=87399) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 18:06:47 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-1437bcde-2518-4b4c-9c3b-c231e91aec57 req-78ab86eb-824f-4ffa-91bd-a91df7c59c0c tempest-DeleteServersTestJSON-915525219 None] attachment_update completed successfully. Jul 10 18:06:50 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:06:50 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] Flow 'volume_create_manager' (50eebd14-3399-4fbf-a94c-1f28ba980ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:06:50 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d512d9-7cb3-4ed3-bdfc-b29d0f09f64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:06:50 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d512d9-7cb3-4ed3-bdfc-b29d0f09f64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1845098870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe71757-1633-4a0a-8e23-c960a6f40234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2cc828d9cce4d23b3c3d8c1fac3aec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:06:50Z,use_quota=True,user_id='d7b19a2e97514102b8c5615a30a89c93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:06:50 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8425c9de-cc45-4bef-afbe-3268ab294961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:06:50 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8425c9de-cc45-4bef-afbe-3268ab294961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:06:50 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddfdfec4-2ef5-4e00-947f-b85cd9e0a227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:06:50 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddfdfec4-2ef5-4e00-947f-b85cd9e0a227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fe71757-1633-4a0a-8e23-c960a6f40234', 'volume_name': 'volume-0fe71757-1633-4a0a-8e23-c960a6f40234', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:06:50 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e346be9-03ee-4b21-8ae9-45a8a0bbe82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:06:50 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e346be9-03ee-4b21-8ae9-45a8a0bbe82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:06:50 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670a9559-2cde-47c0-8d33-d591c2ef95b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:06:50 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] Volume 0fe71757-1633-4a0a-8e23-c960a6f40234: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fe71757-1633-4a0a-8e23-c960a6f40234', 'volume_size': 1} Jul 10 18:06:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:06:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:06:50 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1845098870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe71757-1633-4a0a-8e23-c960a6f40234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2cc828d9cce4d23b3c3d8c1fac3aec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:06:50Z,use_quota=True,user_id='d7b19a2e97514102b8c5615a30a89c93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:06:50 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] Creating volume 0fe71757-1633-4a0a-8e23-c960a6f40234 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:06:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:06:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:06:50 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:06:50 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:06:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:06:50 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:06:50 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:06:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0fe71757-1633-4a0a-8e23-c960a6f40234 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:06:50 devstack sudo[88812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0fe71757-1633-4a0a-8e23-c960a6f40234 1073741824 Jul 10 18:06:50 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:06:51 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root Jul 10 18:06:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0fe71757-1633-4a0a-8e23-c960a6f40234 1073741824" returned: 0 in 1.382s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:06:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0fe71757-1633-4a0a-8e23-c960a6f40234 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:06:51 devstack sudo[88818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0fe71757-1633-4a0a-8e23-c960a6f40234 Jul 10 18:06:51 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:06:53 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root Jul 10 18:06:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0fe71757-1633-4a0a-8e23-c960a6f40234" returned: 0 in 1.352s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:06:53 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] <== create_volume: return (2842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:06:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.845s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:06:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670a9559-2cde-47c0-8d33-d591c2ef95b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fe71757-1633-4a0a-8e23-c960a6f40234', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:06:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13c1d3a3-ca5f-4e97-8a5d-be2309622484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:06:53 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] Volume volume-0fe71757-1633-4a0a-8e23-c960a6f40234 (0fe71757-1633-4a0a-8e23-c960a6f40234): created successfully Jul 10 18:06:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13c1d3a3-ca5f-4e97-8a5d-be2309622484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:06:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] Flow 'volume_create_manager' (50eebd14-3399-4fbf-a94c-1f28ba980ff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:06:53 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-beb0e679-ee2f-4625-aa1e-0450e94e70a1 tempest-VolumesAdminNegativeTest-352465064 None] Created volume successfully. Jul 10 18:06:54 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-a3c7d4f5-d344-4ee0-921f-a98c01046ce0 tempest-GroupsV314Test-61474305 None] Group tempest-GroupsV314Test-Group-2067844158: creating Jul 10 18:06:54 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-a3c7d4f5-d344-4ee0-921f-a98c01046ce0 tempest-GroupsV314Test-61474305 None] Group tempest-GroupsV314Test-Group-2067844158: created successfully Jul 10 18:06:54 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-a3c7d4f5-d344-4ee0-921f-a98c01046ce0 tempest-GroupsV314Test-61474305 None] Create group completed successfully. Jul 10 18:06:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-88b7400f-b951-44ad-816d-af58b1e06335 tempest-VolumesAdminNegativeTest-352465064 None] Acquiring lock "cinder-0fe71757-1633-4a0a-8e23-c960a6f40234-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:06:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-88b7400f-b951-44ad-816d-af58b1e06335 tempest-VolumesAdminNegativeTest-352465064 None] Lock "cinder-0fe71757-1633-4a0a-8e23-c960a6f40234-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:06:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-88b7400f-b951-44ad-816d-af58b1e06335 tempest-VolumesAdminNegativeTest-352465064 None] Acquiring lock "cinder-quobyte-0fe71757-1633-4a0a-8e23-c960a6f40234" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:06:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-88b7400f-b951-44ad-816d-af58b1e06335 tempest-VolumesAdminNegativeTest-352465064 None] Lock "cinder-quobyte-0fe71757-1633-4a0a-8e23-c960a6f40234" acquired by "delete_volume" :: waited 0.084s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:06:55 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac781f7-5898-4fec-aa37-78a5f378b6c0]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:06:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-88b7400f-b951-44ad-816d-af58b1e06335 tempest-VolumesAdminNegativeTest-352465064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0fe71757-1633-4a0a-8e23-c960a6f40234 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:06:56 devstack sudo[88868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0fe71757-1633-4a0a-8e23-c960a6f40234 Jul 10 18:06:56 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:06:57 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:06:57 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] Flow 'volume_create_manager' (69eb963f-bacf-4466-bcd4-13d1cc7cdec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:06:57 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec5dac24-574d-4b82-b882-1e0bbd2aa4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:06:57 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec5dac24-574d-4b82-b882-1e0bbd2aa4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1720095503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ecfe4aa5-7743-4c67-9f15-b4cf0b438e6a,host='devstack@QuobyteHD#QuobyteHD',id=220ff022-3257-400c-bb43-58ba3b34f57d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0401a52c37aa4c04972ee873fb533ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:06:57Z,use_quota=True,user_id='c294ead264354d53a464b1e7c0869fdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85919154-a45d-47ee-9bdc-100b9548a07f),volume_type_id=85919154-a45d-47ee-9bdc-100b9548a07f)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:06:57 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce6c7d4-6b8f-4133-974f-03ddaa95c46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:06:57 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce6c7d4-6b8f-4133-974f-03ddaa95c46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:06:57 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (252b613d-043e-48bb-857c-34492ad4fa2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:06:57 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (252b613d-043e-48bb-857c-34492ad4fa2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '220ff022-3257-400c-bb43-58ba3b34f57d', 'volume_name': 'volume-220ff022-3257-400c-bb43-58ba3b34f57d', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:06:57 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c299d1b2-65e1-4b3f-ab23-1a472b6e2167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:06:57 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c299d1b2-65e1-4b3f-ab23-1a472b6e2167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:06:57 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ab0d74-3550-4a8d-baf2-1426317e05ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:06:57 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] Volume 220ff022-3257-400c-bb43-58ba3b34f57d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-220ff022-3257-400c-bb43-58ba3b34f57d', 'volume_size': 1} Jul 10 18:06:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:06:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:06:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ecfe4aa5-7743-4c67-9f15-b4cf0b438e6a,created_at=2026-07-10T16:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1720095503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ecfe4aa5-7743-4c67-9f15-b4cf0b438e6a,host='devstack@QuobyteHD#QuobyteHD',id=220ff022-3257-400c-bb43-58ba3b34f57d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0401a52c37aa4c04972ee873fb533ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:06:57Z,use_quota=True,user_id='c294ead264354d53a464b1e7c0869fdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85919154-a45d-47ee-9bdc-100b9548a07f),volume_type_id=85919154-a45d-47ee-9bdc-100b9548a07f)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:06:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] Creating volume 220ff022-3257-400c-bb43-58ba3b34f57d {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:06:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:06:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:06:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:06:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:06:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:06:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:06:57 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:06:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:06:57 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:06:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:06:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:06:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:06:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:06:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:06:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:06:57 devstack sudo[88881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:06:57 devstack sudo[88881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:06:57 devstack sudo[88880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d 1073741824 Jul 10 18:06:57 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:06:58 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root Jul 10 18:06:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-88b7400f-b951-44ad-816d-af58b1e06335 tempest-VolumesAdminNegativeTest-352465064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0fe71757-1633-4a0a-8e23-c960a6f40234" returned: 0 in 2.843s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:06:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-88b7400f-b951-44ad-816d-af58b1e06335 tempest-VolumesAdminNegativeTest-352465064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0fe71757-1633-4a0a-8e23-c960a6f40234 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:06:58 devstack sudo[88881]: pam_unix(sudo:session): session closed for user root Jul 10 18:06:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.270s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:06:58 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:06:58 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager._thread_info {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:06:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread count: 8 {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 18:06:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread info: [<_MainThread(MainThread, started 139757428633728)>, , , , , , , ] {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 18:06:58 devstack sudo[88896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0fe71757-1633-4a0a-8e23-c960a6f40234 Jul 10 18:06:58 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:06:59 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-38f143c9-8e1c-46f9-9895-fe21eaf570fc req-b66b1a56-95f7-4d85-ab81-b21f7a91e05f tempest-DeleteServersTestJSON-915525219 None] Terminate volume connection completed successfully. Jul 10 18:06:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-38f143c9-8e1c-46f9-9895-fe21eaf570fc req-b66b1a56-95f7-4d85-ab81-b21f7a91e05f tempest-DeleteServersTestJSON-915525219 None] Deleting attachment 13da6d16-ce6a-45e7-8868-3cc1e57f22b1. {{(pid=87399) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 18:06:59 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root Jul 10 18:06:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d 1073741824" returned: 0 in 2.211s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:06:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:06:59 devstack sudo[88906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d Jul 10 18:06:59 devstack sudo[88906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:06:59 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root Jul 10 18:06:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-88b7400f-b951-44ad-816d-af58b1e06335 tempest-VolumesAdminNegativeTest-352465064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0fe71757-1633-4a0a-8e23-c960a6f40234" returned: 0 in 1.280s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:00 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-88b7400f-b951-44ad-816d-af58b1e06335 tempest-VolumesAdminNegativeTest-352465064 None] Lock "cinder-quobyte-0fe71757-1633-4a0a-8e23-c960a6f40234" released by "delete_volume" :: held 4.262s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:07:00 devstack cinder-volume[87399]: WARNING cinder.quota [None req-88b7400f-b951-44ad-816d-af58b1e06335 tempest-VolumesAdminNegativeTest-352465064 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 18:07:00 devstack cinder-volume[87399]: WARNING cinder.quota [None req-88b7400f-b951-44ad-816d-af58b1e06335 tempest-VolumesAdminNegativeTest-352465064 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 18:07:00 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-88b7400f-b951-44ad-816d-af58b1e06335 tempest-VolumesAdminNegativeTest-352465064 None] Created reservations ['a2f2dd56-18b3-4f08-bbd1-76da863e4c07', '2530e3c2-7b0d-43e7-a55b-e723a6149a6d', '42f8040c-31a5-4108-b97c-a52cb6e8516c', '15a7ef81-5a39-450a-92f3-bfdc1cbf7dd7'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:07:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-88b7400f-b951-44ad-816d-af58b1e06335 tempest-VolumesAdminNegativeTest-352465064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:07:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-88b7400f-b951-44ad-816d-af58b1e06335 tempest-VolumesAdminNegativeTest-352465064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:07:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-88b7400f-b951-44ad-816d-af58b1e06335 tempest-VolumesAdminNegativeTest-352465064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:07:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-88b7400f-b951-44ad-816d-af58b1e06335 tempest-VolumesAdminNegativeTest-352465064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:07:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-88b7400f-b951-44ad-816d-af58b1e06335 tempest-VolumesAdminNegativeTest-352465064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:07:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-88b7400f-b951-44ad-816d-af58b1e06335 tempest-VolumesAdminNegativeTest-352465064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:07:00 devstack sudo[88953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:07:00 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:07:01 devstack sudo[88906]: pam_unix(sudo:session): session closed for user root Jul 10 18:07:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d" returned: 0 in 1.304s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:01 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] <== create_volume: return (3565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:07:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.568s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:07:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ab0d74-3550-4a8d-baf2-1426317e05ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-220ff022-3257-400c-bb43-58ba3b34f57d', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:07:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2186191-67db-43a4-a703-c25c840ab17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:07:01 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] Volume volume-220ff022-3257-400c-bb43-58ba3b34f57d (220ff022-3257-400c-bb43-58ba3b34f57d): created successfully Jul 10 18:07:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2186191-67db-43a4-a703-c25c840ab17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:07:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] Flow 'volume_create_manager' (69eb963f-bacf-4466-bcd4-13d1cc7cdec0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:07:01 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-3e7157e8-366f-492c-a877-edecf673eb35 tempest-GroupsV314Test-61474305 None] Created volume successfully. Jul 10 18:07:01 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root Jul 10 18:07:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-88b7400f-b951-44ad-816d-af58b1e06335 tempest-VolumesAdminNegativeTest-352465064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.985s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:01 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-88b7400f-b951-44ad-816d-af58b1e06335 tempest-VolumesAdminNegativeTest-352465064 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:07:01 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-88b7400f-b951-44ad-816d-af58b1e06335 tempest-VolumesAdminNegativeTest-352465064 None] Deleted volume successfully. Jul 10 18:07:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-88b7400f-b951-44ad-816d-af58b1e06335 tempest-VolumesAdminNegativeTest-352465064 None] Lock "cinder-0fe71757-1633-4a0a-8e23-c960a6f40234-delete_volume" released by "delete_volume" :: held 5.811s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:07:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:07:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:07:03 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Cloning volume 220ff022-3257-400c-bb43-58ba3b34f57d to volume e50207e2-a8bd-43d2-a635-b7b0c8a1aaae Jul 10 18:07:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Creating offline snapshot d7b9b158-5bd0-4458-b8c5-f5dc230d2d62 of volume 220ff022-3257-400c-bb43-58ba3b34f57d {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:07:03 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3faefa-c1c1-4ae2-ad7f-3d750d2fa7a2]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:07:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:07:03 devstack sudo[88980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d Jul 10 18:07:03 devstack sudo[88980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:07:04 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-60dbe8df-d6e1-4ff7-813b-3123af064c63 tempest-DeleteServersTestJSON-915525219 None] Acquiring lock "cinder-4c594c39-4904-4199-9b1f-1e1b94eff7eb-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:07:04 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-60dbe8df-d6e1-4ff7-813b-3123af064c63 tempest-DeleteServersTestJSON-915525219 None] Lock "cinder-4c594c39-4904-4199-9b1f-1e1b94eff7eb-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:07:04 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-60dbe8df-d6e1-4ff7-813b-3123af064c63 tempest-DeleteServersTestJSON-915525219 None] Acquiring lock "cinder-quobyte-4c594c39-4904-4199-9b1f-1e1b94eff7eb" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:07:04 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-60dbe8df-d6e1-4ff7-813b-3123af064c63 tempest-DeleteServersTestJSON-915525219 None] Lock "cinder-quobyte-4c594c39-4904-4199-9b1f-1e1b94eff7eb" acquired by "delete_volume" :: waited 0.028s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:07:04 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10c4c1c-374d-43c1-898b-2e424f9a0471]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:07:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-60dbe8df-d6e1-4ff7-813b-3123af064c63 tempest-DeleteServersTestJSON-915525219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4c594c39-4904-4199-9b1f-1e1b94eff7eb {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:07:04 devstack sudo[88980]: pam_unix(sudo:session): session closed for user root Jul 10 18:07:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d" returned: 0 in 1.243s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d.d7b9b158-5bd0-4458-b8c5-f5dc230d2d62 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:07:04 devstack sudo[89009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d.d7b9b158-5bd0-4458-b8c5-f5dc230d2d62 1G Jul 10 18:07:04 devstack sudo[89009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:07:04 devstack sudo[89007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4c594c39-4904-4199-9b1f-1e1b94eff7eb Jul 10 18:07:04 devstack sudo[89007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:07:05 devstack sudo[89007]: pam_unix(sudo:session): session closed for user root Jul 10 18:07:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-60dbe8df-d6e1-4ff7-813b-3123af064c63 tempest-DeleteServersTestJSON-915525219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4c594c39-4904-4199-9b1f-1e1b94eff7eb" returned: 0 in 0.860s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-60dbe8df-d6e1-4ff7-813b-3123af064c63 tempest-DeleteServersTestJSON-915525219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4c594c39-4904-4199-9b1f-1e1b94eff7eb {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:07:05 devstack sudo[89021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4c594c39-4904-4199-9b1f-1e1b94eff7eb Jul 10 18:07:05 devstack sudo[89021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:07:05 devstack sudo[89009]: pam_unix(sudo:session): session closed for user root Jul 10 18:07:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d.d7b9b158-5bd0-4458-b8c5-f5dc230d2d62 1G" returned: 0 in 0.871s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-220ff022-3257-400c-bb43-58ba3b34f57d -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d.d7b9b158-5bd0-4458-b8c5-f5dc230d2d62 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:07:05 devstack sudo[89023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-220ff022-3257-400c-bb43-58ba3b34f57d -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d.d7b9b158-5bd0-4458-b8c5-f5dc230d2d62 Jul 10 18:07:05 devstack sudo[89023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:07:05 devstack sudo[89021]: pam_unix(sudo:session): session closed for user root Jul 10 18:07:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-60dbe8df-d6e1-4ff7-813b-3123af064c63 tempest-DeleteServersTestJSON-915525219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4c594c39-4904-4199-9b1f-1e1b94eff7eb" returned: 0 in 0.670s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:05 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-60dbe8df-d6e1-4ff7-813b-3123af064c63 tempest-DeleteServersTestJSON-915525219 None] Lock "cinder-quobyte-4c594c39-4904-4199-9b1f-1e1b94eff7eb" released by "delete_volume" :: held 1.619s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:07:05 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-60dbe8df-d6e1-4ff7-813b-3123af064c63 tempest-DeleteServersTestJSON-915525219 None] Created reservations ['778928da-d225-4e96-be42-26a1d11529a4', '0663fca6-3f6f-4fb2-bff8-eb9cef853fb4', 'afc47d4e-9516-45af-bcc6-4367adccb038', '3c2e2b17-9e3f-4498-92f9-043efd5bf39e'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:07:05 devstack sudo[89023]: pam_unix(sudo:session): session closed for user root Jul 10 18:07:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-220ff022-3257-400c-bb43-58ba3b34f57d -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d.d7b9b158-5bd0-4458-b8c5-f5dc230d2d62" returned: 0 in 0.734s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:05 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d.d7b9b158-5bd0-4458-b8c5-f5dc230d2d62 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 18:07:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d.d7b9b158-5bd0-4458-b8c5-f5dc230d2d62 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:07:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-60dbe8df-d6e1-4ff7-813b-3123af064c63 tempest-DeleteServersTestJSON-915525219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:07:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-60dbe8df-d6e1-4ff7-813b-3123af064c63 tempest-DeleteServersTestJSON-915525219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:07:05 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-60dbe8df-d6e1-4ff7-813b-3123af064c63 tempest-DeleteServersTestJSON-915525219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:07:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-60dbe8df-d6e1-4ff7-813b-3123af064c63 tempest-DeleteServersTestJSON-915525219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:07:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-60dbe8df-d6e1-4ff7-813b-3123af064c63 tempest-DeleteServersTestJSON-915525219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:07:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-60dbe8df-d6e1-4ff7-813b-3123af064c63 tempest-DeleteServersTestJSON-915525219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:07:06 devstack sudo[89030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d.d7b9b158-5bd0-4458-b8c5-f5dc230d2d62 Jul 10 18:07:06 devstack sudo[89030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:07:06 devstack sudo[89032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:07:06 devstack sudo[89032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:07:06 devstack sudo[89030]: pam_unix(sudo:session): session closed for user root Jul 10 18:07:06 devstack sudo[89032]: pam_unix(sudo:session): session closed for user root Jul 10 18:07:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-60dbe8df-d6e1-4ff7-813b-3123af064c63 tempest-DeleteServersTestJSON-915525219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.666s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d.d7b9b158-5bd0-4458-b8c5-f5dc230d2d62" returned: 0 in 0.690s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:06 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-60dbe8df-d6e1-4ff7-813b-3123af064c63 tempest-DeleteServersTestJSON-915525219 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:07:06 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-60dbe8df-d6e1-4ff7-813b-3123af064c63 tempest-DeleteServersTestJSON-915525219 None] Deleted volume successfully. Jul 10 18:07:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:07:06 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-60dbe8df-d6e1-4ff7-813b-3123af064c63 tempest-DeleteServersTestJSON-915525219 None] Lock "cinder-4c594c39-4904-4199-9b1f-1e1b94eff7eb-delete_volume" released by "delete_volume" :: held 2.671s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:07:06 devstack sudo[89037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d.info Jul 10 18:07:06 devstack sudo[89037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:07:07 devstack sudo[89037]: pam_unix(sudo:session): session closed for user root Jul 10 18:07:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d.info" returned: 0 in 0.701s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:07 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 18:07:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:07:07 devstack sudo[89040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d.info Jul 10 18:07:07 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:07:08 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root Jul 10 18:07:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d.info" returned: 0 in 0.694s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:08 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Acquiring lock "cinder-quobyte-e50207e2-a8bd-43d2-a635-b7b0c8a1aaae" by "_copy_volume_from_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:07:08 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Lock "cinder-quobyte-e50207e2-a8bd-43d2-a635-b7b0c8a1aaae" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:07:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] snapshot: d7b9b158-5bd0-4458-b8c5-f5dc230d2d62, volume: e50207e2-a8bd-43d2-a635-b7b0c8a1aaae, {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 18:07:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:07:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:07:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:07:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:07:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:07:08 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[8950c048-0336-44c4-b4d8-4a4a5dc21eae]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:07:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d.d7b9b158-5bd0-4458-b8c5-f5dc230d2d62 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:07:08 devstack sudo[89044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d.d7b9b158-5bd0-4458-b8c5-f5dc230d2d62 Jul 10 18:07:08 devstack sudo[89044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:07:09 devstack sudo[89044]: pam_unix(sudo:session): session closed for user root Jul 10 18:07:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d.d7b9b158-5bd0-4458-b8c5-f5dc230d2d62" returned: 0 in 0.893s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-220ff022-3257-400c-bb43-58ba3b34f57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:07:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] will copy from snapshot at /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 18:07:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Creating direct copy from snapshot {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 18:07:09 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29dd193-bbc3-4bf4-9d9e-8db767723581]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:07:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:07:09 devstack sudo[89049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d Jul 10 18:07:09 devstack sudo[89049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:07:10 devstack sudo[89049]: pam_unix(sudo:session): session closed for user root Jul 10 18:07:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d" returned: 0 in 0.935s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:10 devstack cinder-volume[87399]: DEBUG cinder.utils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Path /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e50207e2-a8bd-43d2-a635-b7b0c8a1aaae not found in is_blk_device check {{(pid=87399) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 18:07:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e50207e2-a8bd-43d2-a635-b7b0c8a1aaae {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:07:10 devstack sudo[89057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e50207e2-a8bd-43d2-a635-b7b0c8a1aaae Jul 10 18:07:10 devstack sudo[89057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:07:16 devstack sudo[89057]: pam_unix(sudo:session): session closed for user root Jul 10 18:07:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e50207e2-a8bd-43d2-a635-b7b0c8a1aaae" returned: 0 in 6.648s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:16 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=29,cinder:UPDATE=30,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:07:16 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca54a47-1a68-4b81-9b90-93dc6ce8f99d]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:07:16 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=28,cinder:UPDATE=23,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:07:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:07:16 devstack sudo[89090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d Jul 10 18:07:16 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:07:17 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root Jul 10 18:07:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d" returned: 0 in 1.172s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:17 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Image conversion details: src /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d, size 1024.00 MB, duration 6.65 sec, destination /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e50207e2-a8bd-43d2-a635-b7b0c8a1aaae {{(pid=87399) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 18:07:17 devstack cinder-volume[87399]: INFO cinder.image.image_utils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Converted 1024.00 MB image at 154.01 MB/s Jul 10 18:07:17 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e50207e2-a8bd-43d2-a635-b7b0c8a1aaae is being set with open permissions: ugo+rw: NotImplementedError Jul 10 18:07:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e50207e2-a8bd-43d2-a635-b7b0c8a1aaae {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:07:18 devstack sudo[89099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e50207e2-a8bd-43d2-a635-b7b0c8a1aaae Jul 10 18:07:18 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:07:18 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root Jul 10 18:07:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e50207e2-a8bd-43d2-a635-b7b0c8a1aaae" returned: 0 in 0.748s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:18 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Lock "cinder-quobyte-e50207e2-a8bd-43d2-a635-b7b0c8a1aaae" released by "_copy_volume_from_snapshot" :: held 10.552s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:07:18 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Acquiring lock "cinder-quobyte-d7b9b158-5bd0-4458-b8c5-f5dc230d2d62" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:07:18 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Lock "cinder-quobyte-d7b9b158-5bd0-4458-b8c5-f5dc230d2d62" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:07:18 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Deleting offline snapshot d7b9b158-5bd0-4458-b8c5-f5dc230d2d62 of volume 220ff022-3257-400c-bb43-58ba3b34f57d {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:07:18 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] snapshot_file for this snap is: volume-220ff022-3257-400c-bb43-58ba3b34f57d.d7b9b158-5bd0-4458-b8c5-f5dc230d2d62 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:07:18 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ebb674-6bad-43ef-bf46-15a4a5fa9b61]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:07:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d.d7b9b158-5bd0-4458-b8c5-f5dc230d2d62 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:07:18 devstack sudo[89111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d.d7b9b158-5bd0-4458-b8c5-f5dc230d2d62 Jul 10 18:07:18 devstack sudo[89111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:07:19 devstack sudo[89111]: pam_unix(sudo:session): session closed for user root Jul 10 18:07:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d.d7b9b158-5bd0-4458-b8c5-f5dc230d2d62" returned: 0 in 0.921s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:19 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-220ff022-3257-400c-bb43-58ba3b34f57d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:07:19 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fedfa0f-0355-4c02-be93-3aba4bf1c7c8]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:07:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:07:19 devstack sudo[89116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d Jul 10 18:07:19 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:07:20 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root Jul 10 18:07:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d" returned: 0 in 0.849s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d.d7b9b158-5bd0-4458-b8c5-f5dc230d2d62 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:07:20 devstack sudo[89121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d.d7b9b158-5bd0-4458-b8c5-f5dc230d2d62 Jul 10 18:07:20 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:07:21 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root Jul 10 18:07:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d.d7b9b158-5bd0-4458-b8c5-f5dc230d2d62" returned: 0 in 0.825s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d.d7b9b158-5bd0-4458-b8c5-f5dc230d2d62 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:07:21 devstack sudo[89128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d.d7b9b158-5bd0-4458-b8c5-f5dc230d2d62 Jul 10 18:07:21 devstack sudo[89128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:07:22 devstack sudo[89128]: pam_unix(sudo:session): session closed for user root Jul 10 18:07:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d.d7b9b158-5bd0-4458-b8c5-f5dc230d2d62" returned: 0 in 0.770s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:22 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Lock "cinder-quobyte-d7b9b158-5bd0-4458-b8c5-f5dc230d2d62" released by "_delete_snapshot" :: held 3.479s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:07:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.270s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:07:22 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-6d44f19f-8b6d-4f89-8bc2-47ec3969b8ac tempest-GroupsV314Test-61474305 None] Create group from source-group-ecfe4aa5-7743-4c67-9f15-b4cf0b438e6a completed successfully. Jul 10 18:07:23 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5632d403-375c-46aa-a4d4-ef179995a557 tempest-GroupsV314Test-61474305 None] Acquiring lock "cinder-quobyte-e50207e2-a8bd-43d2-a635-b7b0c8a1aaae" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:07:23 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5632d403-375c-46aa-a4d4-ef179995a557 tempest-GroupsV314Test-61474305 None] Lock "cinder-quobyte-e50207e2-a8bd-43d2-a635-b7b0c8a1aaae" acquired by "delete_volume" :: waited 0.022s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:07:23 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[f648f264-1a04-4d66-993a-b2af8aa80838]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:07:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5632d403-375c-46aa-a4d4-ef179995a557 tempest-GroupsV314Test-61474305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e50207e2-a8bd-43d2-a635-b7b0c8a1aaae {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:07:23 devstack sudo[89132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e50207e2-a8bd-43d2-a635-b7b0c8a1aaae Jul 10 18:07:23 devstack sudo[89132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:07:24 devstack sudo[89132]: pam_unix(sudo:session): session closed for user root Jul 10 18:07:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5632d403-375c-46aa-a4d4-ef179995a557 tempest-GroupsV314Test-61474305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e50207e2-a8bd-43d2-a635-b7b0c8a1aaae" returned: 0 in 0.898s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5632d403-375c-46aa-a4d4-ef179995a557 tempest-GroupsV314Test-61474305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e50207e2-a8bd-43d2-a635-b7b0c8a1aaae {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:07:24 devstack sudo[89137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e50207e2-a8bd-43d2-a635-b7b0c8a1aaae Jul 10 18:07:24 devstack sudo[89137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:07:24 devstack sudo[89137]: pam_unix(sudo:session): session closed for user root Jul 10 18:07:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5632d403-375c-46aa-a4d4-ef179995a557 tempest-GroupsV314Test-61474305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e50207e2-a8bd-43d2-a635-b7b0c8a1aaae" returned: 0 in 0.713s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:24 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5632d403-375c-46aa-a4d4-ef179995a557 tempest-GroupsV314Test-61474305 None] Lock "cinder-quobyte-e50207e2-a8bd-43d2-a635-b7b0c8a1aaae" released by "delete_volume" :: held 1.684s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:07:24 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-5632d403-375c-46aa-a4d4-ef179995a557 tempest-GroupsV314Test-61474305 None] Created reservations ['9ecf1b76-5c78-4f05-a63d-ad796df8df4b'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:07:24 devstack cinder-volume[87399]: WARNING cinder.quota [None req-5632d403-375c-46aa-a4d4-ef179995a557 tempest-GroupsV314Test-61474305 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-972768234 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-972768234, it is now deprecated. Please use the default quota class for default quota. Jul 10 18:07:24 devstack cinder-volume[87399]: WARNING cinder.quota [None req-5632d403-375c-46aa-a4d4-ef179995a557 tempest-GroupsV314Test-61474305 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-972768234 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-972768234, it is now deprecated. Please use the default quota class for default quota. Jul 10 18:07:24 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-5632d403-375c-46aa-a4d4-ef179995a557 tempest-GroupsV314Test-61474305 None] Created reservations ['c76a80d3-8581-48cd-a694-03b6b12f9695', '37baf1fa-2ee9-4c65-ba4c-3d7eafd6754e', '260539f0-e518-4501-8875-07b17ab7505c', '3cb247c3-8cc3-4da9-a548-1576e1b8e364'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:07:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5632d403-375c-46aa-a4d4-ef179995a557 tempest-GroupsV314Test-61474305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:07:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5632d403-375c-46aa-a4d4-ef179995a557 tempest-GroupsV314Test-61474305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:07:25 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5632d403-375c-46aa-a4d4-ef179995a557 tempest-GroupsV314Test-61474305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:07:25 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5632d403-375c-46aa-a4d4-ef179995a557 tempest-GroupsV314Test-61474305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:07:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5632d403-375c-46aa-a4d4-ef179995a557 tempest-GroupsV314Test-61474305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:07:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5632d403-375c-46aa-a4d4-ef179995a557 tempest-GroupsV314Test-61474305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:07:25 devstack sudo[89141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:07:25 devstack sudo[89141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:07:25 devstack sudo[89141]: pam_unix(sudo:session): session closed for user root Jul 10 18:07:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5632d403-375c-46aa-a4d4-ef179995a557 tempest-GroupsV314Test-61474305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.799s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:25 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-5632d403-375c-46aa-a4d4-ef179995a557 tempest-GroupsV314Test-61474305 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:07:25 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-5632d403-375c-46aa-a4d4-ef179995a557 tempest-GroupsV314Test-61474305 None] Delete group completed successfully. Jul 10 18:07:26 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e22dab99-59f9-4538-a9dc-d407ec983a8e tempest-GroupsV314Test-61474305 None] Acquiring lock "cinder-quobyte-220ff022-3257-400c-bb43-58ba3b34f57d" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:07:26 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e22dab99-59f9-4538-a9dc-d407ec983a8e tempest-GroupsV314Test-61474305 None] Lock "cinder-quobyte-220ff022-3257-400c-bb43-58ba3b34f57d" acquired by "delete_volume" :: waited 0.023s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:07:26 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c5fdc7-bf19-44b7-ba54-797517e2eb87]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:07:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e22dab99-59f9-4538-a9dc-d407ec983a8e tempest-GroupsV314Test-61474305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:07:26 devstack sudo[89145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d Jul 10 18:07:26 devstack sudo[89145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:07:27 devstack sudo[89145]: pam_unix(sudo:session): session closed for user root Jul 10 18:07:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e22dab99-59f9-4538-a9dc-d407ec983a8e tempest-GroupsV314Test-61474305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d" returned: 0 in 0.905s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e22dab99-59f9-4538-a9dc-d407ec983a8e tempest-GroupsV314Test-61474305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:07:27 devstack sudo[89150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d Jul 10 18:07:27 devstack sudo[89150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:07:27 devstack sudo[89150]: pam_unix(sudo:session): session closed for user root Jul 10 18:07:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e22dab99-59f9-4538-a9dc-d407ec983a8e tempest-GroupsV314Test-61474305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-220ff022-3257-400c-bb43-58ba3b34f57d" returned: 0 in 0.930s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:27 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e22dab99-59f9-4538-a9dc-d407ec983a8e tempest-GroupsV314Test-61474305 None] Lock "cinder-quobyte-220ff022-3257-400c-bb43-58ba3b34f57d" released by "delete_volume" :: held 1.926s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:07:28 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-e22dab99-59f9-4538-a9dc-d407ec983a8e tempest-GroupsV314Test-61474305 None] Created reservations ['a68c57ec-69e6-4419-837b-00e63e52c89c'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:07:28 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-e22dab99-59f9-4538-a9dc-d407ec983a8e tempest-GroupsV314Test-61474305 None] Created reservations ['4497014d-a221-47b1-be9d-e1f67d968986', '96a66883-baa0-4343-a0ce-228c38f4830d', '0bd3d436-08d0-4fe1-8ece-e2c2c133bab4', '526d4480-cb07-4d61-bc87-906edb21d833'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:07:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e22dab99-59f9-4538-a9dc-d407ec983a8e tempest-GroupsV314Test-61474305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:07:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e22dab99-59f9-4538-a9dc-d407ec983a8e tempest-GroupsV314Test-61474305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:07:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e22dab99-59f9-4538-a9dc-d407ec983a8e tempest-GroupsV314Test-61474305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:07:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e22dab99-59f9-4538-a9dc-d407ec983a8e tempest-GroupsV314Test-61474305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:07:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e22dab99-59f9-4538-a9dc-d407ec983a8e tempest-GroupsV314Test-61474305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:07:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e22dab99-59f9-4538-a9dc-d407ec983a8e tempest-GroupsV314Test-61474305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:07:28 devstack sudo[89155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:07:28 devstack sudo[89155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:07:29 devstack sudo[89155]: pam_unix(sudo:session): session closed for user root Jul 10 18:07:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e22dab99-59f9-4538-a9dc-d407ec983a8e tempest-GroupsV314Test-61474305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.913s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:29 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-e22dab99-59f9-4538-a9dc-d407ec983a8e tempest-GroupsV314Test-61474305 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:07:29 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-e22dab99-59f9-4538-a9dc-d407ec983a8e tempest-GroupsV314Test-61474305 None] Delete group completed successfully. Jul 10 18:07:38 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=22,cinder:UPDATE=21,cinder:INSERT=3 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:07:38 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:UPDATE=29,cinder:SELECT=15,cinder:INSERT=7 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:07:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-fd60b19b-59a5-4c6b-8ad3-95605749404f req-dd38e6ec-0ead-4c41-88c1-91b5bf751bc9 tempest-TaggedAttachmentsTest-724296020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:07:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-fd60b19b-59a5-4c6b-8ad3-95605749404f req-dd38e6ec-0ead-4c41-88c1-91b5bf751bc9 tempest-TaggedAttachmentsTest-724296020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:07:40 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7e7d85-ee2a-457f-a177-26b1be537f92]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:07:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-fd60b19b-59a5-4c6b-8ad3-95605749404f req-dd38e6ec-0ead-4c41-88c1-91b5bf751bc9 tempest-TaggedAttachmentsTest-724296020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3531327b-9ea1-42ef-8e7e-d8e4e8ccfda6 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:07:40 devstack sudo[89278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3531327b-9ea1-42ef-8e7e-d8e4e8ccfda6 Jul 10 18:07:40 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:07:41 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root Jul 10 18:07:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-fd60b19b-59a5-4c6b-8ad3-95605749404f req-dd38e6ec-0ead-4c41-88c1-91b5bf751bc9 tempest-TaggedAttachmentsTest-724296020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3531327b-9ea1-42ef-8e7e-d8e4e8ccfda6" returned: 0 in 1.082s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-fd60b19b-59a5-4c6b-8ad3-95605749404f req-dd38e6ec-0ead-4c41-88c1-91b5bf751bc9 tempest-TaggedAttachmentsTest-724296020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.110s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:07:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-fd60b19b-59a5-4c6b-8ad3-95605749404f req-dd38e6ec-0ead-4c41-88c1-91b5bf751bc9 tempest-TaggedAttachmentsTest-724296020 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd', 'name': 'volume-3531327b-9ea1-42ef-8e7e-d8e4e8ccfda6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4f53d9da-9d31-470e-9e9e-1cf708eed1ca', 'enforce_multipath': True} {{(pid=87399) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 18:07:41 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-fd60b19b-59a5-4c6b-8ad3-95605749404f req-dd38e6ec-0ead-4c41-88c1-91b5bf751bc9 tempest-TaggedAttachmentsTest-724296020 None] attachment_update completed successfully. Jul 10 18:07:49 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:07:49 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] Flow 'volume_create_manager' (423f107f-7852-4693-867d-2d10d99ce31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:07:49 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08b8a855-9d9a-4ff3-b790-1cfd6a6ceff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:07:49 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08b8a855-9d9a-4ff3-b790-1cfd6a6ceff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-352167245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e639b0a0-7795-4646-a61c-63d8139216eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d8d593bdd0c4ee18310225fcd597a0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:07:50Z,use_quota=True,user_id='6a0a84b4980e4491ac270922f955bf6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:07:49 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a9fc21f-f6f6-49de-bef0-715e7caf1e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:07:49 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a9fc21f-f6f6-49de-bef0-715e7caf1e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:07:49 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c60e7c8-c2b0-4876-a2a0-2f79634a536e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:07:49 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c60e7c8-c2b0-4876-a2a0-2f79634a536e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e639b0a0-7795-4646-a61c-63d8139216eb', 'volume_name': 'volume-e639b0a0-7795-4646-a61c-63d8139216eb', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:07:49 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a958969-c50f-482e-ad1f-60233486e92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:07:49 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a958969-c50f-482e-ad1f-60233486e92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:07:49 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a294e70b-9cb3-441b-bce3-839b23762c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:07:49 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] Volume e639b0a0-7795-4646-a61c-63d8139216eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e639b0a0-7795-4646-a61c-63d8139216eb', 'volume_size': 1} Jul 10 18:07:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:07:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:07:49 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-352167245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e639b0a0-7795-4646-a61c-63d8139216eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d8d593bdd0c4ee18310225fcd597a0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:07:50Z,use_quota=True,user_id='6a0a84b4980e4491ac270922f955bf6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:07:49 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] Creating volume e639b0a0-7795-4646-a61c-63d8139216eb {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:07:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:07:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:07:49 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:07:49 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:07:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:07:49 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:07:49 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:07:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e639b0a0-7795-4646-a61c-63d8139216eb 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:07:49 devstack sudo[89764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e639b0a0-7795-4646-a61c-63d8139216eb 1073741824 Jul 10 18:07:49 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:07:50 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root Jul 10 18:07:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e639b0a0-7795-4646-a61c-63d8139216eb 1073741824" returned: 0 in 0.926s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e639b0a0-7795-4646-a61c-63d8139216eb {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:07:50 devstack sudo[89770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e639b0a0-7795-4646-a61c-63d8139216eb Jul 10 18:07:50 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:07:51 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-f620ca28-add7-462e-8248-cc1c201bd357 req-3686db3f-aaca-47ab-abc9-22124b442a8d tempest-TaggedAttachmentsTest-724296020 None] Terminate volume connection completed successfully. Jul 10 18:07:51 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-f620ca28-add7-462e-8248-cc1c201bd357 req-3686db3f-aaca-47ab-abc9-22124b442a8d tempest-TaggedAttachmentsTest-724296020 None] Deleting attachment 4f53d9da-9d31-470e-9e9e-1cf708eed1ca. {{(pid=87399) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 18:07:51 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root Jul 10 18:07:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e639b0a0-7795-4646-a61c-63d8139216eb" returned: 0 in 1.002s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:51 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] <== create_volume: return (1990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:07:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.993s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:07:51 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a294e70b-9cb3-441b-bce3-839b23762c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e639b0a0-7795-4646-a61c-63d8139216eb', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:07:51 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be1f71e1-ae79-43cb-9337-e45ad8ecb731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:07:51 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] Volume volume-e639b0a0-7795-4646-a61c-63d8139216eb (e639b0a0-7795-4646-a61c-63d8139216eb): created successfully Jul 10 18:07:51 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be1f71e1-ae79-43cb-9337-e45ad8ecb731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:07:51 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] Flow 'volume_create_manager' (423f107f-7852-4693-867d-2d10d99ce31c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:07:51 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-1891ae8a-4bfc-415c-b2cf-96f100f1d7ae tempest-VolumesListAdminTestJSON-1703773296 None] Created volume successfully. Jul 10 18:07:54 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:07:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] Flow 'volume_create_manager' (c941c5e7-2273-465c-9831-4aec396de3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:07:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bef6734-e3bc-4f7b-9d04-f9669cffa2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:07:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bef6734-e3bc-4f7b-9d04-f9669cffa2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1686803997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b2f9fcf-33e7-4e04-aa41-8d0eb7ab2491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d8d593bdd0c4ee18310225fcd597a0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:07:54Z,use_quota=True,user_id='6a0a84b4980e4491ac270922f955bf6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:07:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4055cebf-b032-4bef-be1f-401bc2b991c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:07:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4055cebf-b032-4bef-be1f-401bc2b991c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:07:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d48379b6-4712-4134-8ce7-4a546c85e6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:07:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d48379b6-4712-4134-8ce7-4a546c85e6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b2f9fcf-33e7-4e04-aa41-8d0eb7ab2491', 'volume_name': 'volume-3b2f9fcf-33e7-4e04-aa41-8d0eb7ab2491', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:07:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab1c8dd-4180-47eb-8729-f1792f367014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:07:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab1c8dd-4180-47eb-8729-f1792f367014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:07:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (788316b9-b9e8-4b50-b661-aca2a054be8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:07:54 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] Volume 3b2f9fcf-33e7-4e04-aa41-8d0eb7ab2491: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b2f9fcf-33e7-4e04-aa41-8d0eb7ab2491', 'volume_size': 1} Jul 10 18:07:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:07:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:07:54 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1686803997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b2f9fcf-33e7-4e04-aa41-8d0eb7ab2491,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d8d593bdd0c4ee18310225fcd597a0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:07:54Z,use_quota=True,user_id='6a0a84b4980e4491ac270922f955bf6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:07:54 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] Creating volume 3b2f9fcf-33e7-4e04-aa41-8d0eb7ab2491 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:07:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:07:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:07:54 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:07:54 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:07:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:07:54 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:07:54 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:07:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3b2f9fcf-33e7-4e04-aa41-8d0eb7ab2491 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:07:54 devstack sudo[89821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3b2f9fcf-33e7-4e04-aa41-8d0eb7ab2491 1073741824 Jul 10 18:07:54 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:07:55 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root Jul 10 18:07:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3b2f9fcf-33e7-4e04-aa41-8d0eb7ab2491 1073741824" returned: 0 in 1.508s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3b2f9fcf-33e7-4e04-aa41-8d0eb7ab2491 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:07:55 devstack sudo[89853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3b2f9fcf-33e7-4e04-aa41-8d0eb7ab2491 Jul 10 18:07:55 devstack sudo[89853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:07:56 devstack sudo[89853]: pam_unix(sudo:session): session closed for user root Jul 10 18:07:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3b2f9fcf-33e7-4e04-aa41-8d0eb7ab2491" returned: 0 in 1.260s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] <== create_volume: return (2850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:07:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.856s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:07:56 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (788316b9-b9e8-4b50-b661-aca2a054be8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b2f9fcf-33e7-4e04-aa41-8d0eb7ab2491', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:07:56 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f228b6d5-04ed-4340-a103-b378b9613daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:07:57 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] Volume volume-3b2f9fcf-33e7-4e04-aa41-8d0eb7ab2491 (3b2f9fcf-33e7-4e04-aa41-8d0eb7ab2491): created successfully Jul 10 18:07:57 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f228b6d5-04ed-4340-a103-b378b9613daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:07:57 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] Flow 'volume_create_manager' (c941c5e7-2273-465c-9831-4aec396de3d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:07:57 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-7f708631-51e1-4dd3-af5d-15708de8580e tempest-VolumesListAdminTestJSON-1703773296 None] Created volume successfully. Jul 10 18:07:57 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:07:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:07:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:07:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:07:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:07:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:07:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:07:57 devstack sudo[89878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:07:57 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:07:58 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:07:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] Flow 'volume_create_manager' (5dfbc65b-20b2-4442-82f3-c5f04935d959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:07:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7142c8f-8045-4539-9103-e254f6c365a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:07:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7142c8f-8045-4539-9103-e254f6c365a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-471205456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=082f5bd7-c8c4-486c-a8ce-932462b57169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d8d593bdd0c4ee18310225fcd597a0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:07:58Z,use_quota=True,user_id='6a0a84b4980e4491ac270922f955bf6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:07:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b22745b-be65-4260-be18-803b9825d1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:07:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b22745b-be65-4260-be18-803b9825d1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:07:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c08d7d5-d2e7-4fdb-ad35-7c407a214163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:07:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c08d7d5-d2e7-4fdb-ad35-7c407a214163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '082f5bd7-c8c4-486c-a8ce-932462b57169', 'volume_name': 'volume-082f5bd7-c8c4-486c-a8ce-932462b57169', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:07:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (781f0da6-fdd4-4d46-a77d-19466ae70e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:07:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (781f0da6-fdd4-4d46-a77d-19466ae70e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:07:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb9787b0-d242-4e04-88c2-118353330132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:07:58 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] Volume 082f5bd7-c8c4-486c-a8ce-932462b57169: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-082f5bd7-c8c4-486c-a8ce-932462b57169', 'volume_size': 1} Jul 10 18:07:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:07:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:07:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:07:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-471205456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=082f5bd7-c8c4-486c-a8ce-932462b57169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d8d593bdd0c4ee18310225fcd597a0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:07:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:07:58Z,use_quota=True,user_id='6a0a84b4980e4491ac270922f955bf6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:07:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] Creating volume 082f5bd7-c8c4-486c-a8ce-932462b57169 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:07:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:07:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:07:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:07:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:07:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:07:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:07:58 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:07:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-082f5bd7-c8c4-486c-a8ce-932462b57169 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:07:58 devstack sudo[89887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-082f5bd7-c8c4-486c-a8ce-932462b57169 1073741824 Jul 10 18:07:58 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:07:58 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root Jul 10 18:07:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.292s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:58 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:07:58 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager._thread_info {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:07:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread count: 8 {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 18:07:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread info: [<_MainThread(MainThread, started 139757428633728)>, , , , , , , ] {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 18:07:59 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root Jul 10 18:07:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-082f5bd7-c8c4-486c-a8ce-932462b57169 1073741824" returned: 0 in 1.241s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:07:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-082f5bd7-c8c4-486c-a8ce-932462b57169 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:07:59 devstack sudo[89894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-082f5bd7-c8c4-486c-a8ce-932462b57169 Jul 10 18:07:59 devstack sudo[89894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:00 devstack sudo[89894]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-082f5bd7-c8c4-486c-a8ce-932462b57169" returned: 0 in 0.942s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] <== create_volume: return (2247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:08:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.252s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:08:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb9787b0-d242-4e04-88c2-118353330132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-082f5bd7-c8c4-486c-a8ce-932462b57169', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:08:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360027c2-067f-47db-9e19-f19c30668af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:08:00 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] Volume volume-082f5bd7-c8c4-486c-a8ce-932462b57169 (082f5bd7-c8c4-486c-a8ce-932462b57169): created successfully Jul 10 18:08:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360027c2-067f-47db-9e19-f19c30668af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:08:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] Flow 'volume_create_manager' (5dfbc65b-20b2-4442-82f3-c5f04935d959) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:08:00 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-13ec98bf-7ab0-44ca-af70-a68c36a1f338 tempest-VolumesListAdminTestJSON-1703773296 None] Created volume successfully. Jul 10 18:08:02 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:08:02 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] Flow 'volume_create_manager' (d0c8f08f-1edf-4641-914c-4679ac7ca70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:08:02 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc98a41-bf99-4913-b7d0-a69096754088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:08:02 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc98a41-bf99-4913-b7d0-a69096754088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da3a954d-b9ab-4d6d-9b9f-21179b5af2b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c03564ea7524c8bac948e966ba3014b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:08:02Z,use_quota=True,user_id='d323e7d85aaa48dc91cd82defe700925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:08:02 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0a56dd2-d4f0-43fe-95db-9b1ca03d28b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:08:02 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0a56dd2-d4f0-43fe-95db-9b1ca03d28b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:08:02 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b52142c7-66d2-41a5-987a-c5c3480141bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:08:02 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b52142c7-66d2-41a5-987a-c5c3480141bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da3a954d-b9ab-4d6d-9b9f-21179b5af2b0', 'volume_name': 'volume-da3a954d-b9ab-4d6d-9b9f-21179b5af2b0', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:08:02 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffa110e1-5d54-4a47-b2cc-f3880d7b1f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:08:02 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffa110e1-5d54-4a47-b2cc-f3880d7b1f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:08:02 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40cc9fc2-09f6-4911-9a3c-0580870b8f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:08:02 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] Volume da3a954d-b9ab-4d6d-9b9f-21179b5af2b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da3a954d-b9ab-4d6d-9b9f-21179b5af2b0', 'volume_size': 1} Jul 10 18:08:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:08:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:08:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:08:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da3a954d-b9ab-4d6d-9b9f-21179b5af2b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c03564ea7524c8bac948e966ba3014b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:08:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:08:02Z,use_quota=True,user_id='d323e7d85aaa48dc91cd82defe700925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:08:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] Creating volume da3a954d-b9ab-4d6d-9b9f-21179b5af2b0 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:08:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:08:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:08:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:08:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:08:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:08:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:08:02 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:08:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-da3a954d-b9ab-4d6d-9b9f-21179b5af2b0 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:02 devstack sudo[89992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-da3a954d-b9ab-4d6d-9b9f-21179b5af2b0 1073741824 Jul 10 18:08:02 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:03 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-da3a954d-b9ab-4d6d-9b9f-21179b5af2b0 1073741824" returned: 0 in 1.187s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-da3a954d-b9ab-4d6d-9b9f-21179b5af2b0 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:03 devstack sudo[90025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-da3a954d-b9ab-4d6d-9b9f-21179b5af2b0 Jul 10 18:08:03 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:04 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-da3a954d-b9ab-4d6d-9b9f-21179b5af2b0" returned: 0 in 0.990s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:04 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] <== create_volume: return (2226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:08:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.230s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:08:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40cc9fc2-09f6-4911-9a3c-0580870b8f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da3a954d-b9ab-4d6d-9b9f-21179b5af2b0', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:08:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af7077b6-3598-4040-ae6b-12818439e45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:08:04 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] Volume volume-da3a954d-b9ab-4d6d-9b9f-21179b5af2b0 (da3a954d-b9ab-4d6d-9b9f-21179b5af2b0): created successfully Jul 10 18:08:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af7077b6-3598-4040-ae6b-12818439e45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:08:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] Flow 'volume_create_manager' (d0c8f08f-1edf-4641-914c-4679ac7ca70b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:08:04 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-b7b3f118-a9ad-4106-afc2-d5830031b4e6 tempest-VolumesListAdminTestJSON-1309187574 None] Created volume successfully. Jul 10 18:08:05 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-05abe09a-a543-4dd8-aa77-522c33f5601f tempest-VolumesListAdminTestJSON-1309187574 None] Acquiring lock "cinder-da3a954d-b9ab-4d6d-9b9f-21179b5af2b0-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:08:05 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-05abe09a-a543-4dd8-aa77-522c33f5601f tempest-VolumesListAdminTestJSON-1309187574 None] Lock "cinder-da3a954d-b9ab-4d6d-9b9f-21179b5af2b0-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:08:06 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-05abe09a-a543-4dd8-aa77-522c33f5601f tempest-VolumesListAdminTestJSON-1309187574 None] Acquiring lock "cinder-quobyte-da3a954d-b9ab-4d6d-9b9f-21179b5af2b0" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:08:06 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-05abe09a-a543-4dd8-aa77-522c33f5601f tempest-VolumesListAdminTestJSON-1309187574 None] Lock "cinder-quobyte-da3a954d-b9ab-4d6d-9b9f-21179b5af2b0" acquired by "delete_volume" :: waited 0.036s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:08:06 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ba2462df-2e51-473f-b2b6-8377799a2a97 tempest-VolumesListAdminTestJSON-1703773296 None] Acquiring lock "cinder-082f5bd7-c8c4-486c-a8ce-932462b57169-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:08:06 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[da928513-14eb-4c51-9c3f-2f6901291c70]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:08:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-05abe09a-a543-4dd8-aa77-522c33f5601f tempest-VolumesListAdminTestJSON-1309187574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-da3a954d-b9ab-4d6d-9b9f-21179b5af2b0 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:06 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ba2462df-2e51-473f-b2b6-8377799a2a97 tempest-VolumesListAdminTestJSON-1703773296 None] Lock "cinder-082f5bd7-c8c4-486c-a8ce-932462b57169-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:08:06 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ba2462df-2e51-473f-b2b6-8377799a2a97 tempest-VolumesListAdminTestJSON-1703773296 None] Acquiring lock "cinder-quobyte-082f5bd7-c8c4-486c-a8ce-932462b57169" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:08:06 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ba2462df-2e51-473f-b2b6-8377799a2a97 tempest-VolumesListAdminTestJSON-1703773296 None] Lock "cinder-quobyte-082f5bd7-c8c4-486c-a8ce-932462b57169" acquired by "delete_volume" :: waited 0.040s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:08:06 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2fe033-ff94-4110-bbee-67849b90b6e3]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:08:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ba2462df-2e51-473f-b2b6-8377799a2a97 tempest-VolumesListAdminTestJSON-1703773296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-082f5bd7-c8c4-486c-a8ce-932462b57169 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:06 devstack sudo[90071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-da3a954d-b9ab-4d6d-9b9f-21179b5af2b0 Jul 10 18:08:06 devstack sudo[90071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:06 devstack sudo[90075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-082f5bd7-c8c4-486c-a8ce-932462b57169 Jul 10 18:08:06 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:07 devstack sudo[90071]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-05abe09a-a543-4dd8-aa77-522c33f5601f tempest-VolumesListAdminTestJSON-1309187574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-da3a954d-b9ab-4d6d-9b9f-21179b5af2b0" returned: 0 in 1.519s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-05abe09a-a543-4dd8-aa77-522c33f5601f tempest-VolumesListAdminTestJSON-1309187574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-da3a954d-b9ab-4d6d-9b9f-21179b5af2b0 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:07 devstack sudo[90086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-da3a954d-b9ab-4d6d-9b9f-21179b5af2b0 Jul 10 18:08:07 devstack sudo[90086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:07 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ba2462df-2e51-473f-b2b6-8377799a2a97 tempest-VolumesListAdminTestJSON-1703773296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-082f5bd7-c8c4-486c-a8ce-932462b57169" returned: 0 in 1.406s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ba2462df-2e51-473f-b2b6-8377799a2a97 tempest-VolumesListAdminTestJSON-1703773296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-082f5bd7-c8c4-486c-a8ce-932462b57169 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:07 devstack sudo[90088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-082f5bd7-c8c4-486c-a8ce-932462b57169 Jul 10 18:08:07 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:09 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ba2462df-2e51-473f-b2b6-8377799a2a97 tempest-VolumesListAdminTestJSON-1703773296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-082f5bd7-c8c4-486c-a8ce-932462b57169" returned: 0 in 1.271s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:09 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ba2462df-2e51-473f-b2b6-8377799a2a97 tempest-VolumesListAdminTestJSON-1703773296 None] Lock "cinder-quobyte-082f5bd7-c8c4-486c-a8ce-932462b57169" released by "delete_volume" :: held 2.790s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:08:09 devstack sudo[90086]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-05abe09a-a543-4dd8-aa77-522c33f5601f tempest-VolumesListAdminTestJSON-1309187574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-da3a954d-b9ab-4d6d-9b9f-21179b5af2b0" returned: 0 in 1.505s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:09 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-05abe09a-a543-4dd8-aa77-522c33f5601f tempest-VolumesListAdminTestJSON-1309187574 None] Lock "cinder-quobyte-da3a954d-b9ab-4d6d-9b9f-21179b5af2b0" released by "delete_volume" :: held 3.161s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:08:09 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-ba2462df-2e51-473f-b2b6-8377799a2a97 tempest-VolumesListAdminTestJSON-1703773296 None] Created reservations ['be310c1c-8d68-43df-8522-516609b170c3', 'd429ffbd-a9ef-428d-afc0-fb9601ce6040', '5832603e-470d-481e-a08d-d1358a5df11f', 'f97bc8ab-735e-4f68-9823-73d85cf4260f'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:08:09 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-05abe09a-a543-4dd8-aa77-522c33f5601f tempest-VolumesListAdminTestJSON-1309187574 None] Created reservations ['c0dcc4de-02df-4e40-9420-20a0389653c7', '7f975760-b041-43b8-9dfd-2d048a761e73', '7df62421-e79e-401b-90b1-f7652659e028', 'dad2344b-36f6-4890-92e0-74a3023d395a'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:08:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ba2462df-2e51-473f-b2b6-8377799a2a97 tempest-VolumesListAdminTestJSON-1703773296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:08:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ba2462df-2e51-473f-b2b6-8377799a2a97 tempest-VolumesListAdminTestJSON-1703773296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:08:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ba2462df-2e51-473f-b2b6-8377799a2a97 tempest-VolumesListAdminTestJSON-1703773296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:08:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ba2462df-2e51-473f-b2b6-8377799a2a97 tempest-VolumesListAdminTestJSON-1703773296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:08:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ba2462df-2e51-473f-b2b6-8377799a2a97 tempest-VolumesListAdminTestJSON-1703773296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:08:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ba2462df-2e51-473f-b2b6-8377799a2a97 tempest-VolumesListAdminTestJSON-1703773296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:09 devstack sudo[90093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:08:09 devstack sudo[90093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-05abe09a-a543-4dd8-aa77-522c33f5601f tempest-VolumesListAdminTestJSON-1309187574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:08:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-05abe09a-a543-4dd8-aa77-522c33f5601f tempest-VolumesListAdminTestJSON-1309187574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:08:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-05abe09a-a543-4dd8-aa77-522c33f5601f tempest-VolumesListAdminTestJSON-1309187574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:08:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-05abe09a-a543-4dd8-aa77-522c33f5601f tempest-VolumesListAdminTestJSON-1309187574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:08:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-05abe09a-a543-4dd8-aa77-522c33f5601f tempest-VolumesListAdminTestJSON-1309187574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:08:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-05abe09a-a543-4dd8-aa77-522c33f5601f tempest-VolumesListAdminTestJSON-1309187574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:09 devstack sudo[90095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:08:09 devstack sudo[90095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:10 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-86fda540-f852-49ec-8dd2-6b6067ebd2bc tempest-VolumesListAdminTestJSON-1703773296 None] Acquiring lock "cinder-3b2f9fcf-33e7-4e04-aa41-8d0eb7ab2491-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:08:10 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-86fda540-f852-49ec-8dd2-6b6067ebd2bc tempest-VolumesListAdminTestJSON-1703773296 None] Lock "cinder-3b2f9fcf-33e7-4e04-aa41-8d0eb7ab2491-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:08:10 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-86fda540-f852-49ec-8dd2-6b6067ebd2bc tempest-VolumesListAdminTestJSON-1703773296 None] Acquiring lock "cinder-quobyte-3b2f9fcf-33e7-4e04-aa41-8d0eb7ab2491" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:08:10 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-86fda540-f852-49ec-8dd2-6b6067ebd2bc tempest-VolumesListAdminTestJSON-1703773296 None] Lock "cinder-quobyte-3b2f9fcf-33e7-4e04-aa41-8d0eb7ab2491" acquired by "delete_volume" :: waited 0.028s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:08:10 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[e030ca0d-6865-4eac-9988-7d71ca38b55e]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:08:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-86fda540-f852-49ec-8dd2-6b6067ebd2bc tempest-VolumesListAdminTestJSON-1703773296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3b2f9fcf-33e7-4e04-aa41-8d0eb7ab2491 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:10 devstack sudo[90097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3b2f9fcf-33e7-4e04-aa41-8d0eb7ab2491 Jul 10 18:08:10 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:11 devstack sudo[90095]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-05abe09a-a543-4dd8-aa77-522c33f5601f tempest-VolumesListAdminTestJSON-1309187574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.849s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:11 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-05abe09a-a543-4dd8-aa77-522c33f5601f tempest-VolumesListAdminTestJSON-1309187574 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:08:11 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-05abe09a-a543-4dd8-aa77-522c33f5601f tempest-VolumesListAdminTestJSON-1309187574 None] Deleted volume successfully. Jul 10 18:08:11 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-05abe09a-a543-4dd8-aa77-522c33f5601f tempest-VolumesListAdminTestJSON-1309187574 None] Lock "cinder-da3a954d-b9ab-4d6d-9b9f-21179b5af2b0-delete_volume" released by "delete_volume" :: held 5.799s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:08:11 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-86fda540-f852-49ec-8dd2-6b6067ebd2bc tempest-VolumesListAdminTestJSON-1703773296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3b2f9fcf-33e7-4e04-aa41-8d0eb7ab2491" returned: 0 in 1.560s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-86fda540-f852-49ec-8dd2-6b6067ebd2bc tempest-VolumesListAdminTestJSON-1703773296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3b2f9fcf-33e7-4e04-aa41-8d0eb7ab2491 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:11 devstack sudo[90104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3b2f9fcf-33e7-4e04-aa41-8d0eb7ab2491 Jul 10 18:08:11 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:12 devstack sudo[90093]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ba2462df-2e51-473f-b2b6-8377799a2a97 tempest-VolumesListAdminTestJSON-1703773296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 2.392s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:12 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-ba2462df-2e51-473f-b2b6-8377799a2a97 tempest-VolumesListAdminTestJSON-1703773296 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:08:12 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-ba2462df-2e51-473f-b2b6-8377799a2a97 tempest-VolumesListAdminTestJSON-1703773296 None] Deleted volume successfully. Jul 10 18:08:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ba2462df-2e51-473f-b2b6-8377799a2a97 tempest-VolumesListAdminTestJSON-1703773296 None] Lock "cinder-082f5bd7-c8c4-486c-a8ce-932462b57169-delete_volume" released by "delete_volume" :: held 5.802s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:08:12 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-86fda540-f852-49ec-8dd2-6b6067ebd2bc tempest-VolumesListAdminTestJSON-1703773296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3b2f9fcf-33e7-4e04-aa41-8d0eb7ab2491" returned: 0 in 0.865s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-86fda540-f852-49ec-8dd2-6b6067ebd2bc tempest-VolumesListAdminTestJSON-1703773296 None] Lock "cinder-quobyte-3b2f9fcf-33e7-4e04-aa41-8d0eb7ab2491" released by "delete_volume" :: held 2.512s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:08:12 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-86fda540-f852-49ec-8dd2-6b6067ebd2bc tempest-VolumesListAdminTestJSON-1703773296 None] Created reservations ['ec24f5ac-c551-4b0c-a8af-e50ba95ecd53', 'cd7a6c96-773b-4bad-8557-049dc32cf04e', '3a10401c-3696-4155-a824-2da1187054c5', '6a4d9e4c-32cd-4bd0-9fc9-e46d6cd6b4cf'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:08:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-86fda540-f852-49ec-8dd2-6b6067ebd2bc tempest-VolumesListAdminTestJSON-1703773296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:08:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-86fda540-f852-49ec-8dd2-6b6067ebd2bc tempest-VolumesListAdminTestJSON-1703773296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:08:13 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-86fda540-f852-49ec-8dd2-6b6067ebd2bc tempest-VolumesListAdminTestJSON-1703773296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:08:13 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-86fda540-f852-49ec-8dd2-6b6067ebd2bc tempest-VolumesListAdminTestJSON-1703773296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:08:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-86fda540-f852-49ec-8dd2-6b6067ebd2bc tempest-VolumesListAdminTestJSON-1703773296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:08:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-86fda540-f852-49ec-8dd2-6b6067ebd2bc tempest-VolumesListAdminTestJSON-1703773296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:13 devstack sudo[90107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:08:13 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:14 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5fb3b075-c667-45ce-96af-fb9efb10474b tempest-VolumesListAdminTestJSON-1703773296 None] Acquiring lock "cinder-e639b0a0-7795-4646-a61c-63d8139216eb-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:08:14 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5fb3b075-c667-45ce-96af-fb9efb10474b tempest-VolumesListAdminTestJSON-1703773296 None] Lock "cinder-e639b0a0-7795-4646-a61c-63d8139216eb-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:08:14 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5fb3b075-c667-45ce-96af-fb9efb10474b tempest-VolumesListAdminTestJSON-1703773296 None] Acquiring lock "cinder-quobyte-e639b0a0-7795-4646-a61c-63d8139216eb" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:08:14 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5fb3b075-c667-45ce-96af-fb9efb10474b tempest-VolumesListAdminTestJSON-1703773296 None] Lock "cinder-quobyte-e639b0a0-7795-4646-a61c-63d8139216eb" acquired by "delete_volume" :: waited 0.036s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:08:14 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[da52f787-f871-48c3-8eb9-c0c25101e9c3]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:08:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5fb3b075-c667-45ce-96af-fb9efb10474b tempest-VolumesListAdminTestJSON-1703773296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e639b0a0-7795-4646-a61c-63d8139216eb {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:14 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-86fda540-f852-49ec-8dd2-6b6067ebd2bc tempest-VolumesListAdminTestJSON-1703773296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.341s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:14 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-86fda540-f852-49ec-8dd2-6b6067ebd2bc tempest-VolumesListAdminTestJSON-1703773296 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:08:14 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-86fda540-f852-49ec-8dd2-6b6067ebd2bc tempest-VolumesListAdminTestJSON-1703773296 None] Deleted volume successfully. Jul 10 18:08:14 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-86fda540-f852-49ec-8dd2-6b6067ebd2bc tempest-VolumesListAdminTestJSON-1703773296 None] Lock "cinder-3b2f9fcf-33e7-4e04-aa41-8d0eb7ab2491-delete_volume" released by "delete_volume" :: held 4.270s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:08:14 devstack sudo[90112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e639b0a0-7795-4646-a61c-63d8139216eb Jul 10 18:08:14 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:14 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-59ff4fc0-6ad5-4bd7-ba5b-d7668c7293f0 tempest-TaggedAttachmentsTest-724296020 None] Acquiring lock "cinder-3531327b-9ea1-42ef-8e7e-d8e4e8ccfda6-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:08:14 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-59ff4fc0-6ad5-4bd7-ba5b-d7668c7293f0 tempest-TaggedAttachmentsTest-724296020 None] Lock "cinder-3531327b-9ea1-42ef-8e7e-d8e4e8ccfda6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:08:14 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-59ff4fc0-6ad5-4bd7-ba5b-d7668c7293f0 tempest-TaggedAttachmentsTest-724296020 None] Acquiring lock "cinder-quobyte-3531327b-9ea1-42ef-8e7e-d8e4e8ccfda6" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:08:14 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-59ff4fc0-6ad5-4bd7-ba5b-d7668c7293f0 tempest-TaggedAttachmentsTest-724296020 None] Lock "cinder-quobyte-3531327b-9ea1-42ef-8e7e-d8e4e8ccfda6" acquired by "delete_volume" :: waited 0.028s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:08:14 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f145a3-f068-4f72-b295-e6014c52fe22]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:08:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-59ff4fc0-6ad5-4bd7-ba5b-d7668c7293f0 tempest-TaggedAttachmentsTest-724296020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3531327b-9ea1-42ef-8e7e-d8e4e8ccfda6 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:15 devstack sudo[90121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3531327b-9ea1-42ef-8e7e-d8e4e8ccfda6 Jul 10 18:08:15 devstack sudo[90121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:15 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5fb3b075-c667-45ce-96af-fb9efb10474b tempest-VolumesListAdminTestJSON-1703773296 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e639b0a0-7795-4646-a61c-63d8139216eb" returned: 0 in 1.244s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5fb3b075-c667-45ce-96af-fb9efb10474b tempest-VolumesListAdminTestJSON-1703773296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e639b0a0-7795-4646-a61c-63d8139216eb {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:15 devstack sudo[90126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e639b0a0-7795-4646-a61c-63d8139216eb Jul 10 18:08:15 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:15 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:08:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] Flow 'volume_create_manager' (bf1b27f6-560c-4f1d-99c1-077677333198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:08:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a26c4c9-c4a3-4d0c-919e-afce60a86786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:08:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a26c4c9-c4a3-4d0c-919e-afce60a86786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1633256597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d210b9e1-60c2-459e-8904-05069637a521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b81bbaf334ce44e89d088fbc4edcf968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:08:16Z,use_quota=True,user_id='b81084f0c711452caec146fe046a0149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:08:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe580c4-f694-4351-9174-ed1cfb79e673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:08:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe580c4-f694-4351-9174-ed1cfb79e673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:08:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb2d1ba-e515-449e-9ca3-db66d0fe104b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:08:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb2d1ba-e515-449e-9ca3-db66d0fe104b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd210b9e1-60c2-459e-8904-05069637a521', 'volume_name': 'volume-d210b9e1-60c2-459e-8904-05069637a521', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:08:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4efafe7f-760d-4d56-8730-26f37c89337c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:08:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4efafe7f-760d-4d56-8730-26f37c89337c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:08:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99789637-29b1-444b-bdce-dfe75c19bee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:08:16 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] Volume d210b9e1-60c2-459e-8904-05069637a521: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d210b9e1-60c2-459e-8904-05069637a521', 'volume_size': 1} Jul 10 18:08:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:08:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:08:16 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1633256597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d210b9e1-60c2-459e-8904-05069637a521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b81bbaf334ce44e89d088fbc4edcf968',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:08:16Z,use_quota=True,user_id='b81084f0c711452caec146fe046a0149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:08:16 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] Creating volume d210b9e1-60c2-459e-8904-05069637a521 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:08:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:08:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:08:16 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:08:16 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:08:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:08:16 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:08:16 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:08:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d210b9e1-60c2-459e-8904-05069637a521 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:16 devstack sudo[90141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d210b9e1-60c2-459e-8904-05069637a521 1073741824 Jul 10 18:08:16 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:16 devstack sudo[90121]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-59ff4fc0-6ad5-4bd7-ba5b-d7668c7293f0 tempest-TaggedAttachmentsTest-724296020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3531327b-9ea1-42ef-8e7e-d8e4e8ccfda6" returned: 0 in 1.312s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-59ff4fc0-6ad5-4bd7-ba5b-d7668c7293f0 tempest-TaggedAttachmentsTest-724296020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3531327b-9ea1-42ef-8e7e-d8e4e8ccfda6 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:16 devstack sudo[90143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3531327b-9ea1-42ef-8e7e-d8e4e8ccfda6 Jul 10 18:08:16 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:17 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5fb3b075-c667-45ce-96af-fb9efb10474b tempest-VolumesListAdminTestJSON-1703773296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e639b0a0-7795-4646-a61c-63d8139216eb" returned: 0 in 1.616s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:17 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5fb3b075-c667-45ce-96af-fb9efb10474b tempest-VolumesListAdminTestJSON-1703773296 None] Lock "cinder-quobyte-e639b0a0-7795-4646-a61c-63d8139216eb" released by "delete_volume" :: held 2.914s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:08:17 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-5fb3b075-c667-45ce-96af-fb9efb10474b tempest-VolumesListAdminTestJSON-1703773296 None] Created reservations ['1b3f2069-a803-4e30-b933-17c0e8f0ac53', '86239c2f-d8fa-4588-bb61-82c6ec478e72', 'c4ceeaa3-01f1-4756-bba6-749dfa9754df', '8ea0385e-56a7-4a31-802c-07840ab4fa7c'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:08:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5fb3b075-c667-45ce-96af-fb9efb10474b tempest-VolumesListAdminTestJSON-1703773296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:08:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5fb3b075-c667-45ce-96af-fb9efb10474b tempest-VolumesListAdminTestJSON-1703773296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:08:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5fb3b075-c667-45ce-96af-fb9efb10474b tempest-VolumesListAdminTestJSON-1703773296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:08:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5fb3b075-c667-45ce-96af-fb9efb10474b tempest-VolumesListAdminTestJSON-1703773296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:08:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5fb3b075-c667-45ce-96af-fb9efb10474b tempest-VolumesListAdminTestJSON-1703773296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:08:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5fb3b075-c667-45ce-96af-fb9efb10474b tempest-VolumesListAdminTestJSON-1703773296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:17 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-59ff4fc0-6ad5-4bd7-ba5b-d7668c7293f0 tempest-TaggedAttachmentsTest-724296020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3531327b-9ea1-42ef-8e7e-d8e4e8ccfda6" returned: 0 in 1.200s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:17 devstack sudo[90151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:08:17 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:17 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-59ff4fc0-6ad5-4bd7-ba5b-d7668c7293f0 tempest-TaggedAttachmentsTest-724296020 None] Lock "cinder-quobyte-3531327b-9ea1-42ef-8e7e-d8e4e8ccfda6" released by "delete_volume" :: held 2.574s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:08:17 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-59ff4fc0-6ad5-4bd7-ba5b-d7668c7293f0 tempest-TaggedAttachmentsTest-724296020 None] Created reservations ['e332f3ad-5197-4a98-93c9-8feb08902b2b', '1c8a6198-5fdd-4eaf-9b0d-134eb2af369f', 'b3dbf0bb-4aea-4ac3-bdc3-de6a0d6ee780', '38e4e95d-86ab-4483-8a08-559386720f68'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:08:17 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d210b9e1-60c2-459e-8904-05069637a521 1073741824" returned: 0 in 1.616s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d210b9e1-60c2-459e-8904-05069637a521 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:17 devstack sudo[90171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d210b9e1-60c2-459e-8904-05069637a521 Jul 10 18:08:17 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-59ff4fc0-6ad5-4bd7-ba5b-d7668c7293f0 tempest-TaggedAttachmentsTest-724296020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:08:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-59ff4fc0-6ad5-4bd7-ba5b-d7668c7293f0 tempest-TaggedAttachmentsTest-724296020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:08:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-59ff4fc0-6ad5-4bd7-ba5b-d7668c7293f0 tempest-TaggedAttachmentsTest-724296020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:08:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-59ff4fc0-6ad5-4bd7-ba5b-d7668c7293f0 tempest-TaggedAttachmentsTest-724296020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:08:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-59ff4fc0-6ad5-4bd7-ba5b-d7668c7293f0 tempest-TaggedAttachmentsTest-724296020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:08:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-59ff4fc0-6ad5-4bd7-ba5b-d7668c7293f0 tempest-TaggedAttachmentsTest-724296020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:17 devstack sudo[90173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:08:17 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:18 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-59ff4fc0-6ad5-4bd7-ba5b-d7668c7293f0 tempest-TaggedAttachmentsTest-724296020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.008s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:18 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-59ff4fc0-6ad5-4bd7-ba5b-d7668c7293f0 tempest-TaggedAttachmentsTest-724296020 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:08:18 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-59ff4fc0-6ad5-4bd7-ba5b-d7668c7293f0 tempest-TaggedAttachmentsTest-724296020 None] Deleted volume successfully. Jul 10 18:08:18 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-59ff4fc0-6ad5-4bd7-ba5b-d7668c7293f0 tempest-TaggedAttachmentsTest-724296020 None] Lock "cinder-3531327b-9ea1-42ef-8e7e-d8e4e8ccfda6-delete_volume" released by "delete_volume" :: held 4.214s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:08:18 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5fb3b075-c667-45ce-96af-fb9efb10474b tempest-VolumesListAdminTestJSON-1703773296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.572s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:18 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-5fb3b075-c667-45ce-96af-fb9efb10474b tempest-VolumesListAdminTestJSON-1703773296 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:08:19 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-5fb3b075-c667-45ce-96af-fb9efb10474b tempest-VolumesListAdminTestJSON-1703773296 None] Deleted volume successfully. Jul 10 18:08:19 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5fb3b075-c667-45ce-96af-fb9efb10474b tempest-VolumesListAdminTestJSON-1703773296 None] Lock "cinder-e639b0a0-7795-4646-a61c-63d8139216eb-delete_volume" released by "delete_volume" :: held 4.918s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:08:19 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d210b9e1-60c2-459e-8904-05069637a521" returned: 0 in 1.300s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:19 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] <== create_volume: return (3046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:08:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.048s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:08:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99789637-29b1-444b-bdce-dfe75c19bee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d210b9e1-60c2-459e-8904-05069637a521', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:08:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6fe3d5e-1714-4ebf-b510-3ff74548fdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:08:19 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] Volume volume-d210b9e1-60c2-459e-8904-05069637a521 (d210b9e1-60c2-459e-8904-05069637a521): created successfully Jul 10 18:08:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6fe3d5e-1714-4ebf-b510-3ff74548fdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:08:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] Flow 'volume_create_manager' (bf1b27f6-560c-4f1d-99c1-077677333198) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:08:19 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-9c5eb6f6-0380-448b-ae9f-6b9eb5ff7355 tempest-ServerActionsTestOtherA-1137861595 None] Created volume successfully. Jul 10 18:08:25 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:08:25 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] Flow 'volume_create_manager' (257e02fb-9e78-4d54-80d4-7a0089889510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:08:25 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ccc547-9929-4401-9cbd-eb03cdd4c1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:08:25 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ccc547-9929-4401-9cbd-eb03cdd4c1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1159394555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=519799c8-b0c1-4186-a633-9c6c8bad946f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2b38c2f46c74b7696f5ed30ff8d08fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:08:25Z,use_quota=True,user_id='abaa80c51f2e44c8babd0d26788e8ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:08:25 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40125aea-da07-4377-8955-886a28166ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:08:25 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40125aea-da07-4377-8955-886a28166ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:08:25 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8a0c8ff-6051-4eb6-8ce4-ae6a0ee1778d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:08:25 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8a0c8ff-6051-4eb6-8ce4-ae6a0ee1778d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '519799c8-b0c1-4186-a633-9c6c8bad946f', 'volume_name': 'volume-519799c8-b0c1-4186-a633-9c6c8bad946f', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:08:25 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc076079-2959-4667-abeb-f1ed6d8a49dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:08:25 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc076079-2959-4667-abeb-f1ed6d8a49dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:08:25 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cc61dbe-34a2-43ee-a776-360e7b81f0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:08:25 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] Volume 519799c8-b0c1-4186-a633-9c6c8bad946f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-519799c8-b0c1-4186-a633-9c6c8bad946f', 'volume_size': 1} Jul 10 18:08:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:08:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:08:25 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:08:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1159394555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=519799c8-b0c1-4186-a633-9c6c8bad946f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2b38c2f46c74b7696f5ed30ff8d08fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:08:25Z,use_quota=True,user_id='abaa80c51f2e44c8babd0d26788e8ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:08:25 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] Creating volume 519799c8-b0c1-4186-a633-9c6c8bad946f {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:08:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:08:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:08:25 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:08:25 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:08:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:08:25 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:08:25 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:08:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-519799c8-b0c1-4186-a633-9c6c8bad946f 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:25 devstack sudo[90245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-519799c8-b0c1-4186-a633-9c6c8bad946f 1073741824 Jul 10 18:08:25 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:26 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-519799c8-b0c1-4186-a633-9c6c8bad946f 1073741824" returned: 0 in 1.502s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-519799c8-b0c1-4186-a633-9c6c8bad946f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:26 devstack sudo[90251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-519799c8-b0c1-4186-a633-9c6c8bad946f Jul 10 18:08:26 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:28 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-519799c8-b0c1-4186-a633-9c6c8bad946f" returned: 0 in 1.168s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] <== create_volume: return (2734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:08:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.738s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:08:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cc61dbe-34a2-43ee-a776-360e7b81f0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-519799c8-b0c1-4186-a633-9c6c8bad946f', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:08:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3801b2f5-f19a-496a-a952-d9e63a62bea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:08:28 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] Volume volume-519799c8-b0c1-4186-a633-9c6c8bad946f (519799c8-b0c1-4186-a633-9c6c8bad946f): created successfully Jul 10 18:08:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3801b2f5-f19a-496a-a952-d9e63a62bea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:08:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] Flow 'volume_create_manager' (257e02fb-9e78-4d54-80d4-7a0089889510) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:08:28 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-863ec514-a07a-452a-a765-cb782ff98995 tempest-ServerRescueNegativeTestJSON-816963652 None] Created volume successfully. Jul 10 18:08:38 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=39,cinder:UPDATE=61,cinder:INSERT=14,cinder:DELETE=2 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:08:38 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=48,cinder:UPDATE=58,cinder:DELETE=9,cinder:INSERT=12 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:08:38 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:08:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] Flow 'volume_create_manager' (2f1698c6-0b53-416d-b2ab-6afddbc396ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:08:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c629d0a-6c12-4fc2-9474-b88309c67633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:08:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c629d0a-6c12-4fc2-9474-b88309c67633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1567335739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ba99695-91c0-43be-8325-1749e4db132c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='539e702e4ba34304b37d9514364dd1fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:08:38Z,use_quota=True,user_id='3a90da7b46f74336a7233105f979a19a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:08:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0c853b9-326e-4e58-a8ee-40f44e717be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:08:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0c853b9-326e-4e58-a8ee-40f44e717be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:08:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b38539-47b4-4df0-9f5c-bc1f4da405a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:08:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b38539-47b4-4df0-9f5c-bc1f4da405a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ba99695-91c0-43be-8325-1749e4db132c', 'volume_name': 'volume-5ba99695-91c0-43be-8325-1749e4db132c', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:08:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce4dd2d5-9c2d-40d3-b2f0-fe0f86044e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:08:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce4dd2d5-9c2d-40d3-b2f0-fe0f86044e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:08:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d737bf2-a0fc-4a0e-8ebe-9d741b2535fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:08:38 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] Volume 5ba99695-91c0-43be-8325-1749e4db132c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ba99695-91c0-43be-8325-1749e4db132c', 'volume_size': 1} Jul 10 18:08:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:08:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:08:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1567335739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ba99695-91c0-43be-8325-1749e4db132c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='539e702e4ba34304b37d9514364dd1fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:08:38Z,use_quota=True,user_id='3a90da7b46f74336a7233105f979a19a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:08:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] Creating volume 5ba99695-91c0-43be-8325-1749e4db132c {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:08:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:08:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:08:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:08:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:08:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:08:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:08:38 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:08:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:38 devstack sudo[90370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c 1073741824 Jul 10 18:08:38 devstack sudo[90370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:39 devstack sudo[90370]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c 1073741824" returned: 0 in 1.145s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:39 devstack sudo[90409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c Jul 10 18:08:39 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:40 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c" returned: 0 in 1.368s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:40 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] <== create_volume: return (2601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:08:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.606s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:08:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d737bf2-a0fc-4a0e-8ebe-9d741b2535fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ba99695-91c0-43be-8325-1749e4db132c', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:08:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f30f4bf1-96ac-45b7-88b6-7414dbf2d682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:08:41 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] Volume volume-5ba99695-91c0-43be-8325-1749e4db132c (5ba99695-91c0-43be-8325-1749e4db132c): created successfully Jul 10 18:08:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f30f4bf1-96ac-45b7-88b6-7414dbf2d682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:08:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] Flow 'volume_create_manager' (2f1698c6-0b53-416d-b2ab-6afddbc396ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:08:41 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-c69b4879-855f-4d10-b9b7-19304a4fcc1c req-6fd505c1-4b1d-4c56-8c1a-bd33af59a2e7 tempest-VolumesSnapshotsTestJSON-226141967 None] Created volume successfully. Jul 10 18:08:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-e3f41f7f-8e3f-4331-bf97-b4656c3bd3af req-a58e01b5-d5e3-4949-a20e-b6028b4fd4b3 tempest-VolumesSnapshotsTestJSON-226141967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:08:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-e3f41f7f-8e3f-4331-bf97-b4656c3bd3af req-a58e01b5-d5e3-4949-a20e-b6028b4fd4b3 tempest-VolumesSnapshotsTestJSON-226141967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:08:42 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [req-e3f41f7f-8e3f-4331-bf97-b4656c3bd3af req-a58e01b5-d5e3-4949-a20e-b6028b4fd4b3 tempest-VolumesSnapshotsTestJSON-226141967 None] Creating offline snapshot 357b5848-5c79-4e42-96f7-2104bbde4e20 of volume 5ba99695-91c0-43be-8325-1749e4db132c {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:08:42 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9614e6-90a4-4065-a8c6-31734534204b]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:08:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-e3f41f7f-8e3f-4331-bf97-b4656c3bd3af req-a58e01b5-d5e3-4949-a20e-b6028b4fd4b3 tempest-VolumesSnapshotsTestJSON-226141967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:42 devstack sudo[90428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c Jul 10 18:08:42 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:44 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-e3f41f7f-8e3f-4331-bf97-b4656c3bd3af req-a58e01b5-d5e3-4949-a20e-b6028b4fd4b3 tempest-VolumesSnapshotsTestJSON-226141967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c" returned: 0 in 2.098s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-e3f41f7f-8e3f-4331-bf97-b4656c3bd3af req-a58e01b5-d5e3-4949-a20e-b6028b4fd4b3 tempest-VolumesSnapshotsTestJSON-226141967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c.357b5848-5c79-4e42-96f7-2104bbde4e20 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:44 devstack sudo[90433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c.357b5848-5c79-4e42-96f7-2104bbde4e20 1G Jul 10 18:08:44 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:46 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-e3f41f7f-8e3f-4331-bf97-b4656c3bd3af req-a58e01b5-d5e3-4949-a20e-b6028b4fd4b3 tempest-VolumesSnapshotsTestJSON-226141967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c.357b5848-5c79-4e42-96f7-2104bbde4e20 1G" returned: 0 in 1.571s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-e3f41f7f-8e3f-4331-bf97-b4656c3bd3af req-a58e01b5-d5e3-4949-a20e-b6028b4fd4b3 tempest-VolumesSnapshotsTestJSON-226141967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ba99695-91c0-43be-8325-1749e4db132c -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c.357b5848-5c79-4e42-96f7-2104bbde4e20 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:46 devstack sudo[90448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ba99695-91c0-43be-8325-1749e4db132c -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c.357b5848-5c79-4e42-96f7-2104bbde4e20 Jul 10 18:08:46 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:47 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-e3f41f7f-8e3f-4331-bf97-b4656c3bd3af req-a58e01b5-d5e3-4949-a20e-b6028b4fd4b3 tempest-VolumesSnapshotsTestJSON-226141967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ba99695-91c0-43be-8325-1749e4db132c -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c.357b5848-5c79-4e42-96f7-2104bbde4e20" returned: 0 in 1.057s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:47 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [req-e3f41f7f-8e3f-4331-bf97-b4656c3bd3af req-a58e01b5-d5e3-4949-a20e-b6028b4fd4b3 tempest-VolumesSnapshotsTestJSON-226141967 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c.357b5848-5c79-4e42-96f7-2104bbde4e20 is being set with open permissions: ugo+rw Jul 10 18:08:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-e3f41f7f-8e3f-4331-bf97-b4656c3bd3af req-a58e01b5-d5e3-4949-a20e-b6028b4fd4b3 tempest-VolumesSnapshotsTestJSON-226141967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c.357b5848-5c79-4e42-96f7-2104bbde4e20 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:47 devstack sudo[90478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c.357b5848-5c79-4e42-96f7-2104bbde4e20 Jul 10 18:08:47 devstack sudo[90478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:48 devstack sudo[90478]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-e3f41f7f-8e3f-4331-bf97-b4656c3bd3af req-a58e01b5-d5e3-4949-a20e-b6028b4fd4b3 tempest-VolumesSnapshotsTestJSON-226141967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c.357b5848-5c79-4e42-96f7-2104bbde4e20" returned: 0 in 1.117s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-e3f41f7f-8e3f-4331-bf97-b4656c3bd3af req-a58e01b5-d5e3-4949-a20e-b6028b4fd4b3 tempest-VolumesSnapshotsTestJSON-226141967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:48 devstack sudo[90482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c.info Jul 10 18:08:48 devstack sudo[90482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:49 devstack sudo[90482]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-e3f41f7f-8e3f-4331-bf97-b4656c3bd3af req-a58e01b5-d5e3-4949-a20e-b6028b4fd4b3 tempest-VolumesSnapshotsTestJSON-226141967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c.info" returned: 0 in 1.298s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:49 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [req-e3f41f7f-8e3f-4331-bf97-b4656c3bd3af req-a58e01b5-d5e3-4949-a20e-b6028b4fd4b3 tempest-VolumesSnapshotsTestJSON-226141967 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c.info is being set with open permissions: ugo+rw Jul 10 18:08:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-e3f41f7f-8e3f-4331-bf97-b4656c3bd3af req-a58e01b5-d5e3-4949-a20e-b6028b4fd4b3 tempest-VolumesSnapshotsTestJSON-226141967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:49 devstack sudo[90485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c.info Jul 10 18:08:49 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:50 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f0092622-68a8-4133-8215-ce57467cfcd1 tempest-ServerRescueNegativeTestJSON-816963652 None] Acquiring lock "cinder-519799c8-b0c1-4186-a633-9c6c8bad946f-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:08:50 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f0092622-68a8-4133-8215-ce57467cfcd1 tempest-ServerRescueNegativeTestJSON-816963652 None] Lock "cinder-519799c8-b0c1-4186-a633-9c6c8bad946f-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:08:50 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f0092622-68a8-4133-8215-ce57467cfcd1 tempest-ServerRescueNegativeTestJSON-816963652 None] Acquiring lock "cinder-quobyte-519799c8-b0c1-4186-a633-9c6c8bad946f" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:08:50 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f0092622-68a8-4133-8215-ce57467cfcd1 tempest-ServerRescueNegativeTestJSON-816963652 None] Lock "cinder-quobyte-519799c8-b0c1-4186-a633-9c6c8bad946f" acquired by "delete_volume" :: waited 0.046s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:08:50 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7906fc-7782-445a-9063-f2b7cf2507de]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:08:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f0092622-68a8-4133-8215-ce57467cfcd1 tempest-ServerRescueNegativeTestJSON-816963652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-519799c8-b0c1-4186-a633-9c6c8bad946f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:50 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-e3f41f7f-8e3f-4331-bf97-b4656c3bd3af req-a58e01b5-d5e3-4949-a20e-b6028b4fd4b3 tempest-VolumesSnapshotsTestJSON-226141967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c.info" returned: 0 in 1.013s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:50 devstack sudo[90488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-519799c8-b0c1-4186-a633-9c6c8bad946f Jul 10 18:08:50 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-e3f41f7f-8e3f-4331-bf97-b4656c3bd3af req-a58e01b5-d5e3-4949-a20e-b6028b4fd4b3 tempest-VolumesSnapshotsTestJSON-226141967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.395s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:08:50 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:08:50 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] Flow 'volume_create_manager' (25607a65-daca-40bc-a51b-83e26e8812c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:08:50 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a52487-a49e-4ea1-83cc-ab6ea6e5ded4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:08:50 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-e3f41f7f-8e3f-4331-bf97-b4656c3bd3af req-a58e01b5-d5e3-4949-a20e-b6028b4fd4b3 tempest-VolumesSnapshotsTestJSON-226141967 None] Create snapshot completed successfully Jul 10 18:08:50 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a52487-a49e-4ea1-83cc-ab6ea6e5ded4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1488182771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9683756df347a394963530cff190b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:08:51Z,use_quota=True,user_id='f17eac3b189a486f9982039f37954132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:08:50 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9478f062-10e0-4e2a-a936-377e3d4471a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:08:50 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9478f062-10e0-4e2a-a936-377e3d4471a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:08:50 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ad9356d-afa2-452e-8613-b414bc212f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:08:50 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ad9356d-afa2-452e-8613-b414bc212f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1', 'volume_name': 'volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:08:50 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bde16cc-e39f-43f8-9338-564bbfc05b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:08:50 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bde16cc-e39f-43f8-9338-564bbfc05b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:08:50 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3141830-db11-4cd4-9310-06e04d5d61f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:08:50 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] Volume b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1', 'volume_size': 1} Jul 10 18:08:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:08:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:08:50 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1488182771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd9683756df347a394963530cff190b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:08:51Z,use_quota=True,user_id='f17eac3b189a486f9982039f37954132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:08:50 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] Creating volume b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:08:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:08:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:08:50 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:08:50 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:08:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:08:50 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:08:50 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:08:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:51 devstack sudo[90490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1 1073741824 Jul 10 18:08:51 devstack sudo[90490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:51 devstack cinder-volume[87399]: DEBUG cinder.coordination [req-a5fd9e13-6a4b-46fc-a64d-92f152c61dc5 req-9072c40a-0264-402d-af88-389d5bdacde0 tempest-VolumesSnapshotsTestJSON-226141967 None] Acquiring lock "cinder-357b5848-5c79-4e42-96f7-2104bbde4e20-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:08:51 devstack cinder-volume[87399]: DEBUG cinder.coordination [req-a5fd9e13-6a4b-46fc-a64d-92f152c61dc5 req-9072c40a-0264-402d-af88-389d5bdacde0 tempest-VolumesSnapshotsTestJSON-226141967 None] Lock "cinder-357b5848-5c79-4e42-96f7-2104bbde4e20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:08:51 devstack cinder-volume[87399]: DEBUG cinder.coordination [req-a5fd9e13-6a4b-46fc-a64d-92f152c61dc5 req-9072c40a-0264-402d-af88-389d5bdacde0 tempest-VolumesSnapshotsTestJSON-226141967 None] Acquiring lock "cinder-quobyte-5ba99695-91c0-43be-8325-1749e4db132c" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:08:51 devstack cinder-volume[87399]: DEBUG cinder.coordination [req-a5fd9e13-6a4b-46fc-a64d-92f152c61dc5 req-9072c40a-0264-402d-af88-389d5bdacde0 tempest-VolumesSnapshotsTestJSON-226141967 None] Lock "cinder-quobyte-5ba99695-91c0-43be-8325-1749e4db132c" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:08:51 devstack cinder-volume[87399]: DEBUG cinder.coordination [req-a5fd9e13-6a4b-46fc-a64d-92f152c61dc5 req-9072c40a-0264-402d-af88-389d5bdacde0 tempest-VolumesSnapshotsTestJSON-226141967 None] Acquiring lock "cinder-quobyte-357b5848-5c79-4e42-96f7-2104bbde4e20" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:08:51 devstack cinder-volume[87399]: DEBUG cinder.coordination [req-a5fd9e13-6a4b-46fc-a64d-92f152c61dc5 req-9072c40a-0264-402d-af88-389d5bdacde0 tempest-VolumesSnapshotsTestJSON-226141967 None] Lock "cinder-quobyte-357b5848-5c79-4e42-96f7-2104bbde4e20" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:08:51 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [req-a5fd9e13-6a4b-46fc-a64d-92f152c61dc5 req-9072c40a-0264-402d-af88-389d5bdacde0 tempest-VolumesSnapshotsTestJSON-226141967 None] Deleting offline snapshot 357b5848-5c79-4e42-96f7-2104bbde4e20 of volume 5ba99695-91c0-43be-8325-1749e4db132c {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:08:51 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [req-a5fd9e13-6a4b-46fc-a64d-92f152c61dc5 req-9072c40a-0264-402d-af88-389d5bdacde0 tempest-VolumesSnapshotsTestJSON-226141967 None] snapshot_file for this snap is: volume-5ba99695-91c0-43be-8325-1749e4db132c.357b5848-5c79-4e42-96f7-2104bbde4e20 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:08:51 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[5693ae17-b6e9-42cc-94f8-3cfb33fbf4d0]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:08:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-a5fd9e13-6a4b-46fc-a64d-92f152c61dc5 req-9072c40a-0264-402d-af88-389d5bdacde0 tempest-VolumesSnapshotsTestJSON-226141967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c.357b5848-5c79-4e42-96f7-2104bbde4e20 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:51 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f0092622-68a8-4133-8215-ce57467cfcd1 tempest-ServerRescueNegativeTestJSON-816963652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-519799c8-b0c1-4186-a633-9c6c8bad946f" returned: 0 in 1.142s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f0092622-68a8-4133-8215-ce57467cfcd1 tempest-ServerRescueNegativeTestJSON-816963652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-519799c8-b0c1-4186-a633-9c6c8bad946f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:51 devstack sudo[90497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-519799c8-b0c1-4186-a633-9c6c8bad946f Jul 10 18:08:51 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:51 devstack sudo[90496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c.357b5848-5c79-4e42-96f7-2104bbde4e20 Jul 10 18:08:51 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:52 devstack sudo[90490]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1 1073741824" returned: 0 in 1.425s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:52 devstack sudo[90505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1 Jul 10 18:08:52 devstack sudo[90505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:52 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f0092622-68a8-4133-8215-ce57467cfcd1 tempest-ServerRescueNegativeTestJSON-816963652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-519799c8-b0c1-4186-a633-9c6c8bad946f" returned: 0 in 1.071s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f0092622-68a8-4133-8215-ce57467cfcd1 tempest-ServerRescueNegativeTestJSON-816963652 None] Lock "cinder-quobyte-519799c8-b0c1-4186-a633-9c6c8bad946f" released by "delete_volume" :: held 2.315s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:08:52 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-a5fd9e13-6a4b-46fc-a64d-92f152c61dc5 req-9072c40a-0264-402d-af88-389d5bdacde0 tempest-VolumesSnapshotsTestJSON-226141967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c.357b5848-5c79-4e42-96f7-2104bbde4e20" returned: 0 in 1.340s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:52 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [req-a5fd9e13-6a4b-46fc-a64d-92f152c61dc5 req-9072c40a-0264-402d-af88-389d5bdacde0 tempest-VolumesSnapshotsTestJSON-226141967 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ba99695-91c0-43be-8325-1749e4db132c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:08:53 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[90625474-71c0-4072-a71c-e5ce6e14a08f]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:08:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-a5fd9e13-6a4b-46fc-a64d-92f152c61dc5 req-9072c40a-0264-402d-af88-389d5bdacde0 tempest-VolumesSnapshotsTestJSON-226141967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:53 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-f0092622-68a8-4133-8215-ce57467cfcd1 tempest-ServerRescueNegativeTestJSON-816963652 None] Created reservations ['581574be-1af6-42d6-8e95-e276f55f8ff7', 'a5933dce-8686-4028-8346-1be474f09af7', '06e2f46c-090e-40dc-b81f-b1bb795cc923', '5af592cc-57cc-4f10-973c-0b4fe04632d3'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:08:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f0092622-68a8-4133-8215-ce57467cfcd1 tempest-ServerRescueNegativeTestJSON-816963652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:08:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f0092622-68a8-4133-8215-ce57467cfcd1 tempest-ServerRescueNegativeTestJSON-816963652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:08:53 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f0092622-68a8-4133-8215-ce57467cfcd1 tempest-ServerRescueNegativeTestJSON-816963652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:08:53 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f0092622-68a8-4133-8215-ce57467cfcd1 tempest-ServerRescueNegativeTestJSON-816963652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:08:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f0092622-68a8-4133-8215-ce57467cfcd1 tempest-ServerRescueNegativeTestJSON-816963652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:08:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f0092622-68a8-4133-8215-ce57467cfcd1 tempest-ServerRescueNegativeTestJSON-816963652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:53 devstack sudo[90512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:08:53 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:53 devstack sudo[90511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c Jul 10 18:08:53 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:53 devstack sudo[90505]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1" returned: 0 in 1.317s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:53 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] <== create_volume: return (2811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:08:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.814s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:08:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3141830-db11-4cd4-9310-06e04d5d61f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:08:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d59285-5b8e-4e99-840a-6ba2140e9f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:08:53 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] Volume volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1 (b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1): created successfully Jul 10 18:08:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d59285-5b8e-4e99-840a-6ba2140e9f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:08:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] Flow 'volume_create_manager' (25607a65-daca-40bc-a51b-83e26e8812c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:08:53 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-942d7675-321e-4abe-900f-90ea4fc5c222 tempest-VolumesActionsTest-825282009 None] Created volume successfully. Jul 10 18:08:54 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f0092622-68a8-4133-8215-ce57467cfcd1 tempest-ServerRescueNegativeTestJSON-816963652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.326s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:54 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-f0092622-68a8-4133-8215-ce57467cfcd1 tempest-ServerRescueNegativeTestJSON-816963652 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:08:54 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-f0092622-68a8-4133-8215-ce57467cfcd1 tempest-ServerRescueNegativeTestJSON-816963652 None] Deleted volume successfully. Jul 10 18:08:54 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f0092622-68a8-4133-8215-ce57467cfcd1 tempest-ServerRescueNegativeTestJSON-816963652 None] Lock "cinder-519799c8-b0c1-4186-a633-9c6c8bad946f-delete_volume" released by "delete_volume" :: held 4.191s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:08:54 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-a5fd9e13-6a4b-46fc-a64d-92f152c61dc5 req-9072c40a-0264-402d-af88-389d5bdacde0 tempest-VolumesSnapshotsTestJSON-226141967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c" returned: 0 in 1.797s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-a5fd9e13-6a4b-46fc-a64d-92f152c61dc5 req-9072c40a-0264-402d-af88-389d5bdacde0 tempest-VolumesSnapshotsTestJSON-226141967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c.357b5848-5c79-4e42-96f7-2104bbde4e20 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:54 devstack sudo[90521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c.357b5848-5c79-4e42-96f7-2104bbde4e20 Jul 10 18:08:54 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:55 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-a5fd9e13-6a4b-46fc-a64d-92f152c61dc5 req-9072c40a-0264-402d-af88-389d5bdacde0 tempest-VolumesSnapshotsTestJSON-226141967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c.357b5848-5c79-4e42-96f7-2104bbde4e20" returned: 0 in 1.106s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-a5fd9e13-6a4b-46fc-a64d-92f152c61dc5 req-9072c40a-0264-402d-af88-389d5bdacde0 tempest-VolumesSnapshotsTestJSON-226141967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c.357b5848-5c79-4e42-96f7-2104bbde4e20 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:55 devstack sudo[90540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c.357b5848-5c79-4e42-96f7-2104bbde4e20 Jul 10 18:08:55 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:57 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-a5fd9e13-6a4b-46fc-a64d-92f152c61dc5 req-9072c40a-0264-402d-af88-389d5bdacde0 tempest-VolumesSnapshotsTestJSON-226141967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c.357b5848-5c79-4e42-96f7-2104bbde4e20" returned: 0 in 1.372s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [req-a5fd9e13-6a4b-46fc-a64d-92f152c61dc5 req-9072c40a-0264-402d-af88-389d5bdacde0 tempest-VolumesSnapshotsTestJSON-226141967 None] Lock "cinder-quobyte-357b5848-5c79-4e42-96f7-2104bbde4e20" released by "_delete_snapshot" :: held 5.831s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:08:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [req-a5fd9e13-6a4b-46fc-a64d-92f152c61dc5 req-9072c40a-0264-402d-af88-389d5bdacde0 tempest-VolumesSnapshotsTestJSON-226141967 None] Lock "cinder-quobyte-5ba99695-91c0-43be-8325-1749e4db132c" released by "delete_snapshot" :: held 5.880s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:08:57 devstack cinder-volume[87399]: WARNING cinder.quota [req-a5fd9e13-6a4b-46fc-a64d-92f152c61dc5 req-9072c40a-0264-402d-af88-389d5bdacde0 tempest-VolumesSnapshotsTestJSON-226141967 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 18:08:57 devstack cinder-volume[87399]: DEBUG cinder.quota [req-a5fd9e13-6a4b-46fc-a64d-92f152c61dc5 req-9072c40a-0264-402d-af88-389d5bdacde0 tempest-VolumesSnapshotsTestJSON-226141967 None] Created reservations ['5c73a3f1-5694-4d8b-956c-78cc24323513', '060f7f80-4501-4686-af84-4ce59bd6526a', '2ac74932-2280-4969-82b0-3f3dff71cced', '697d29dd-2b10-49b2-a362-3205b648eec4'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:08:57 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:08:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:08:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:08:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:08:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:08:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:08:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:57 devstack sudo[90599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:08:57 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:57 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-a5fd9e13-6a4b-46fc-a64d-92f152c61dc5 req-9072c40a-0264-402d-af88-389d5bdacde0 tempest-VolumesSnapshotsTestJSON-226141967 None] Delete snapshot completed successfully. Jul 10 18:08:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [req-a5fd9e13-6a4b-46fc-a64d-92f152c61dc5 req-9072c40a-0264-402d-af88-389d5bdacde0 tempest-VolumesSnapshotsTestJSON-226141967 None] Lock "cinder-357b5848-5c79-4e42-96f7-2104bbde4e20-delete_snapshot" released by "delete_snapshot" :: held 6.201s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:08:58 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.929s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:58 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:08:58 devstack cinder-volume[87399]: DEBUG cinder.coordination [req-59480e02-770a-4069-a41f-a29158196126 req-8428976a-0992-4f99-adad-8c7ddf904500 tempest-VolumesSnapshotsTestJSON-226141967 None] Acquiring lock "cinder-5ba99695-91c0-43be-8325-1749e4db132c-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:08:58 devstack cinder-volume[87399]: DEBUG cinder.coordination [req-59480e02-770a-4069-a41f-a29158196126 req-8428976a-0992-4f99-adad-8c7ddf904500 tempest-VolumesSnapshotsTestJSON-226141967 None] Lock "cinder-5ba99695-91c0-43be-8325-1749e4db132c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:08:58 devstack cinder-volume[87399]: DEBUG cinder.coordination [req-59480e02-770a-4069-a41f-a29158196126 req-8428976a-0992-4f99-adad-8c7ddf904500 tempest-VolumesSnapshotsTestJSON-226141967 None] Acquiring lock "cinder-quobyte-5ba99695-91c0-43be-8325-1749e4db132c" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:08:58 devstack cinder-volume[87399]: DEBUG cinder.coordination [req-59480e02-770a-4069-a41f-a29158196126 req-8428976a-0992-4f99-adad-8c7ddf904500 tempest-VolumesSnapshotsTestJSON-226141967 None] Lock "cinder-quobyte-5ba99695-91c0-43be-8325-1749e4db132c" acquired by "delete_volume" :: waited 0.025s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:08:58 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b96527b-2036-47b1-93a5-11bd2c5978ec]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:08:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-59480e02-770a-4069-a41f-a29158196126 req-8428976a-0992-4f99-adad-8c7ddf904500 tempest-VolumesSnapshotsTestJSON-226141967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:58 devstack sudo[90611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c Jul 10 18:08:58 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:08:59 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root Jul 10 18:08:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-59480e02-770a-4069-a41f-a29158196126 req-8428976a-0992-4f99-adad-8c7ddf904500 tempest-VolumesSnapshotsTestJSON-226141967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c" returned: 0 in 0.794s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:08:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-59480e02-770a-4069-a41f-a29158196126 req-8428976a-0992-4f99-adad-8c7ddf904500 tempest-VolumesSnapshotsTestJSON-226141967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:08:59 devstack sudo[90617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c Jul 10 18:08:59 devstack sudo[90617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:09:00 devstack sudo[90617]: pam_unix(sudo:session): session closed for user root Jul 10 18:09:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-59480e02-770a-4069-a41f-a29158196126 req-8428976a-0992-4f99-adad-8c7ddf904500 tempest-VolumesSnapshotsTestJSON-226141967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5ba99695-91c0-43be-8325-1749e4db132c" returned: 0 in 0.668s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:09:00 devstack cinder-volume[87399]: DEBUG cinder.coordination [req-59480e02-770a-4069-a41f-a29158196126 req-8428976a-0992-4f99-adad-8c7ddf904500 tempest-VolumesSnapshotsTestJSON-226141967 None] Lock "cinder-quobyte-5ba99695-91c0-43be-8325-1749e4db132c" released by "delete_volume" :: held 1.523s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:09:00 devstack cinder-volume[87399]: DEBUG cinder.quota [req-59480e02-770a-4069-a41f-a29158196126 req-8428976a-0992-4f99-adad-8c7ddf904500 tempest-VolumesSnapshotsTestJSON-226141967 None] Created reservations ['5c1d6849-be0a-49e5-b800-6bbdd6bd16dc', '567dee66-4b32-46bc-8b2e-1caf80c8d46a', '0a330cfd-9a38-41f8-8d7e-a3c27aaa59a8', 'e6b87996-339a-4c52-adb5-cd45c7487da9'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:09:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-59480e02-770a-4069-a41f-a29158196126 req-8428976a-0992-4f99-adad-8c7ddf904500 tempest-VolumesSnapshotsTestJSON-226141967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:09:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-59480e02-770a-4069-a41f-a29158196126 req-8428976a-0992-4f99-adad-8c7ddf904500 tempest-VolumesSnapshotsTestJSON-226141967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:09:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [req-59480e02-770a-4069-a41f-a29158196126 req-8428976a-0992-4f99-adad-8c7ddf904500 tempest-VolumesSnapshotsTestJSON-226141967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:09:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [req-59480e02-770a-4069-a41f-a29158196126 req-8428976a-0992-4f99-adad-8c7ddf904500 tempest-VolumesSnapshotsTestJSON-226141967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:09:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-59480e02-770a-4069-a41f-a29158196126 req-8428976a-0992-4f99-adad-8c7ddf904500 tempest-VolumesSnapshotsTestJSON-226141967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:09:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-59480e02-770a-4069-a41f-a29158196126 req-8428976a-0992-4f99-adad-8c7ddf904500 tempest-VolumesSnapshotsTestJSON-226141967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:09:00 devstack sudo[90620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:09:00 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:09:00 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root Jul 10 18:09:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-59480e02-770a-4069-a41f-a29158196126 req-8428976a-0992-4f99-adad-8c7ddf904500 tempest-VolumesSnapshotsTestJSON-226141967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.727s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:09:00 devstack cinder-volume[87399]: DEBUG cinder.manager [req-59480e02-770a-4069-a41f-a29158196126 req-8428976a-0992-4f99-adad-8c7ddf904500 tempest-VolumesSnapshotsTestJSON-226141967 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:09:00 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-59480e02-770a-4069-a41f-a29158196126 req-8428976a-0992-4f99-adad-8c7ddf904500 tempest-VolumesSnapshotsTestJSON-226141967 None] Deleted volume successfully. Jul 10 18:09:00 devstack cinder-volume[87399]: DEBUG cinder.coordination [req-59480e02-770a-4069-a41f-a29158196126 req-8428976a-0992-4f99-adad-8c7ddf904500 tempest-VolumesSnapshotsTestJSON-226141967 None] Lock "cinder-5ba99695-91c0-43be-8325-1749e4db132c-delete_volume" released by "delete_volume" :: held 2.482s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:09:05 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:09:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] Flow 'volume_create_manager' (a1a13df3-5d16-44e0-bfa2-297476f89c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:09:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82b5250d-5a5a-4e0f-a084-8187436057d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:09:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82b5250d-5a5a-4e0f-a084-8187436057d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-807156836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e597fcd6-c0da-4b1f-8138-f6101e9a6e98,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='614f5fe4025a419fb098d9fe222e6ce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:09:06Z,use_quota=True,user_id='d06ef09cf0764f0cab3493fa89ae1ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:09:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95f4d76e-08a8-4377-b6b9-960638765bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:09:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95f4d76e-08a8-4377-b6b9-960638765bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:09:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33435966-dbde-45ff-8e98-5cf7aff31e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:09:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33435966-dbde-45ff-8e98-5cf7aff31e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e597fcd6-c0da-4b1f-8138-f6101e9a6e98', 'volume_name': 'volume-e597fcd6-c0da-4b1f-8138-f6101e9a6e98', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:09:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1db6160-f0d1-49b3-b0e0-45c0651d318f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:09:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1db6160-f0d1-49b3-b0e0-45c0651d318f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:09:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec33ce1-d953-4fa5-b235-e0c8eac5b35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:09:06 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] Volume e597fcd6-c0da-4b1f-8138-f6101e9a6e98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e597fcd6-c0da-4b1f-8138-f6101e9a6e98', 'volume_size': 1} Jul 10 18:09:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:09:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:09:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-807156836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e597fcd6-c0da-4b1f-8138-f6101e9a6e98,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='614f5fe4025a419fb098d9fe222e6ce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:09:06Z,use_quota=True,user_id='d06ef09cf0764f0cab3493fa89ae1ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:09:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] Creating volume e597fcd6-c0da-4b1f-8138-f6101e9a6e98 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:09:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:09:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:09:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:09:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:09:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:09:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:09:06 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:09:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e597fcd6-c0da-4b1f-8138-f6101e9a6e98 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:09:06 devstack sudo[90666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e597fcd6-c0da-4b1f-8138-f6101e9a6e98 1073741824 Jul 10 18:09:06 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:09:06 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root Jul 10 18:09:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e597fcd6-c0da-4b1f-8138-f6101e9a6e98 1073741824" returned: 0 in 0.861s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:09:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e597fcd6-c0da-4b1f-8138-f6101e9a6e98 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:09:07 devstack sudo[90678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e597fcd6-c0da-4b1f-8138-f6101e9a6e98 Jul 10 18:09:07 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:09:08 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root Jul 10 18:09:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e597fcd6-c0da-4b1f-8138-f6101e9a6e98" returned: 0 in 1.060s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:09:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] <== create_volume: return (1977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:09:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.992s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:09:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec33ce1-d953-4fa5-b235-e0c8eac5b35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e597fcd6-c0da-4b1f-8138-f6101e9a6e98', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:09:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7efdcabe-1e03-4165-8fe6-24d7fab94542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:09:08 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] Volume volume-e597fcd6-c0da-4b1f-8138-f6101e9a6e98 (e597fcd6-c0da-4b1f-8138-f6101e9a6e98): created successfully Jul 10 18:09:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7efdcabe-1e03-4165-8fe6-24d7fab94542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:09:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] Flow 'volume_create_manager' (a1a13df3-5d16-44e0-bfa2-297476f89c84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:09:08 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-405ecdd2-72b2-466f-8442-c443abce6a88 req-fad6da8a-5684-438d-970a-3ef9d3583763 tempest-VolumesGetTestJSON-862508022 None] Created volume successfully. Jul 10 18:09:09 devstack cinder-volume[87399]: DEBUG cinder.coordination [req-9f6c64f6-0ce3-414b-b115-cd92f98d52d5 req-d2001fc5-9b03-4c0a-b43b-392fe4a37d87 tempest-VolumesGetTestJSON-862508022 None] Acquiring lock "cinder-e597fcd6-c0da-4b1f-8138-f6101e9a6e98-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:09:09 devstack cinder-volume[87399]: DEBUG cinder.coordination [req-9f6c64f6-0ce3-414b-b115-cd92f98d52d5 req-d2001fc5-9b03-4c0a-b43b-392fe4a37d87 tempest-VolumesGetTestJSON-862508022 None] Lock "cinder-e597fcd6-c0da-4b1f-8138-f6101e9a6e98-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:09:09 devstack cinder-volume[87399]: DEBUG cinder.coordination [req-9f6c64f6-0ce3-414b-b115-cd92f98d52d5 req-d2001fc5-9b03-4c0a-b43b-392fe4a37d87 tempest-VolumesGetTestJSON-862508022 None] Acquiring lock "cinder-quobyte-e597fcd6-c0da-4b1f-8138-f6101e9a6e98" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:09:09 devstack cinder-volume[87399]: DEBUG cinder.coordination [req-9f6c64f6-0ce3-414b-b115-cd92f98d52d5 req-d2001fc5-9b03-4c0a-b43b-392fe4a37d87 tempest-VolumesGetTestJSON-862508022 None] Lock "cinder-quobyte-e597fcd6-c0da-4b1f-8138-f6101e9a6e98" acquired by "delete_volume" :: waited 0.032s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:09:09 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1b0abb-676f-4aa1-9022-388103974b69]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:09:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-9f6c64f6-0ce3-414b-b115-cd92f98d52d5 req-d2001fc5-9b03-4c0a-b43b-392fe4a37d87 tempest-VolumesGetTestJSON-862508022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e597fcd6-c0da-4b1f-8138-f6101e9a6e98 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:09:09 devstack sudo[90752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e597fcd6-c0da-4b1f-8138-f6101e9a6e98 Jul 10 18:09:09 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:09:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-a6441362-abc2-44aa-8de4-7cab0db1de94 req-947e724e-a6ea-4ad9-b5bd-a3bf283bbdf3 tempest-ServerActionsTestOtherA-1137861595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:09:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-a6441362-abc2-44aa-8de4-7cab0db1de94 req-947e724e-a6ea-4ad9-b5bd-a3bf283bbdf3 tempest-ServerActionsTestOtherA-1137861595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:09:10 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b55c10c-298b-4b05-b434-a1deb581d8d5]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:09:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-a6441362-abc2-44aa-8de4-7cab0db1de94 req-947e724e-a6ea-4ad9-b5bd-a3bf283bbdf3 tempest-ServerActionsTestOtherA-1137861595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d210b9e1-60c2-459e-8904-05069637a521 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:09:10 devstack sudo[90767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d210b9e1-60c2-459e-8904-05069637a521 Jul 10 18:09:10 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:09:10 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root Jul 10 18:09:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-9f6c64f6-0ce3-414b-b115-cd92f98d52d5 req-d2001fc5-9b03-4c0a-b43b-392fe4a37d87 tempest-VolumesGetTestJSON-862508022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e597fcd6-c0da-4b1f-8138-f6101e9a6e98" returned: 0 in 1.127s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:09:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-9f6c64f6-0ce3-414b-b115-cd92f98d52d5 req-d2001fc5-9b03-4c0a-b43b-392fe4a37d87 tempest-VolumesGetTestJSON-862508022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e597fcd6-c0da-4b1f-8138-f6101e9a6e98 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:09:10 devstack sudo[90769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e597fcd6-c0da-4b1f-8138-f6101e9a6e98 Jul 10 18:09:10 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:09:11 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root Jul 10 18:09:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-9f6c64f6-0ce3-414b-b115-cd92f98d52d5 req-d2001fc5-9b03-4c0a-b43b-392fe4a37d87 tempest-VolumesGetTestJSON-862508022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e597fcd6-c0da-4b1f-8138-f6101e9a6e98" returned: 0 in 0.821s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:09:11 devstack cinder-volume[87399]: DEBUG cinder.coordination [req-9f6c64f6-0ce3-414b-b115-cd92f98d52d5 req-d2001fc5-9b03-4c0a-b43b-392fe4a37d87 tempest-VolumesGetTestJSON-862508022 None] Lock "cinder-quobyte-e597fcd6-c0da-4b1f-8138-f6101e9a6e98" released by "delete_volume" :: held 2.023s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:09:11 devstack cinder-volume[87399]: DEBUG cinder.quota [req-9f6c64f6-0ce3-414b-b115-cd92f98d52d5 req-d2001fc5-9b03-4c0a-b43b-392fe4a37d87 tempest-VolumesGetTestJSON-862508022 None] Created reservations ['a8d229b3-dfe3-4154-9677-05bb2f6e7997', '83642fa9-e8bd-4f1e-91c9-d947c1f32c50', 'd046f204-55fb-423e-80a7-b46522cf4061', '54c03a83-66a9-4b48-8190-2c4e0cd73581'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:09:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-9f6c64f6-0ce3-414b-b115-cd92f98d52d5 req-d2001fc5-9b03-4c0a-b43b-392fe4a37d87 tempest-VolumesGetTestJSON-862508022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:09:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-9f6c64f6-0ce3-414b-b115-cd92f98d52d5 req-d2001fc5-9b03-4c0a-b43b-392fe4a37d87 tempest-VolumesGetTestJSON-862508022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:09:11 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [req-9f6c64f6-0ce3-414b-b115-cd92f98d52d5 req-d2001fc5-9b03-4c0a-b43b-392fe4a37d87 tempest-VolumesGetTestJSON-862508022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:09:11 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [req-9f6c64f6-0ce3-414b-b115-cd92f98d52d5 req-d2001fc5-9b03-4c0a-b43b-392fe4a37d87 tempest-VolumesGetTestJSON-862508022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:09:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-9f6c64f6-0ce3-414b-b115-cd92f98d52d5 req-d2001fc5-9b03-4c0a-b43b-392fe4a37d87 tempest-VolumesGetTestJSON-862508022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:09:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-9f6c64f6-0ce3-414b-b115-cd92f98d52d5 req-d2001fc5-9b03-4c0a-b43b-392fe4a37d87 tempest-VolumesGetTestJSON-862508022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:09:11 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root Jul 10 18:09:11 devstack sudo[90775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:09:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-a6441362-abc2-44aa-8de4-7cab0db1de94 req-947e724e-a6ea-4ad9-b5bd-a3bf283bbdf3 tempest-ServerActionsTestOtherA-1137861595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d210b9e1-60c2-459e-8904-05069637a521" returned: 0 in 1.308s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:09:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-a6441362-abc2-44aa-8de4-7cab0db1de94 req-947e724e-a6ea-4ad9-b5bd-a3bf283bbdf3 tempest-ServerActionsTestOtherA-1137861595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.343s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:09:11 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:09:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-a6441362-abc2-44aa-8de4-7cab0db1de94 req-947e724e-a6ea-4ad9-b5bd-a3bf283bbdf3 tempest-ServerActionsTestOtherA-1137861595 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd', 'name': 'volume-d210b9e1-60c2-459e-8904-05069637a521', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a9b0c191-b3b3-45bf-8cd9-2bd2d9a3ff50', 'enforce_multipath': True} {{(pid=87399) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 18:09:11 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-a6441362-abc2-44aa-8de4-7cab0db1de94 req-947e724e-a6ea-4ad9-b5bd-a3bf283bbdf3 tempest-ServerActionsTestOtherA-1137861595 None] attachment_update completed successfully. Jul 10 18:09:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c33cab2c-66ee-4ab3-b306-666669d2e1be tempest-VolumesActionsTest-825282009 None] Acquiring lock "cinder-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1" by "attach_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:09:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c33cab2c-66ee-4ab3-b306-666669d2e1be tempest-VolumesActionsTest-825282009 None] Lock "cinder-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1" acquired by "attach_volume" :: waited 0.045s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:09:12 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-c33cab2c-66ee-4ab3-b306-666669d2e1be tempest-VolumesActionsTest-825282009 None] Attaching volume b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1 to instance 1bb35e82-4185-427b-9e49-ad588246ce95 at mountpoint /dev/vdb on host None. Jul 10 18:09:12 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-c33cab2c-66ee-4ab3-b306-666669d2e1be tempest-VolumesActionsTest-825282009 None] Attach volume completed successfully. Jul 10 18:09:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c33cab2c-66ee-4ab3-b306-666669d2e1be tempest-VolumesActionsTest-825282009 None] Lock "cinder-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1" released by "attach_volume" :: held 0.226s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:09:13 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root Jul 10 18:09:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-9f6c64f6-0ce3-414b-b115-cd92f98d52d5 req-d2001fc5-9b03-4c0a-b43b-392fe4a37d87 tempest-VolumesGetTestJSON-862508022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.302s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:09:13 devstack cinder-volume[87399]: DEBUG cinder.manager [req-9f6c64f6-0ce3-414b-b115-cd92f98d52d5 req-d2001fc5-9b03-4c0a-b43b-392fe4a37d87 tempest-VolumesGetTestJSON-862508022 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:09:13 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-9f6c64f6-0ce3-414b-b115-cd92f98d52d5 req-d2001fc5-9b03-4c0a-b43b-392fe4a37d87 tempest-VolumesGetTestJSON-862508022 None] Deleted volume successfully. Jul 10 18:09:13 devstack cinder-volume[87399]: DEBUG cinder.coordination [req-9f6c64f6-0ce3-414b-b115-cd92f98d52d5 req-d2001fc5-9b03-4c0a-b43b-392fe4a37d87 tempest-VolumesGetTestJSON-862508022 None] Lock "cinder-e597fcd6-c0da-4b1f-8138-f6101e9a6e98-delete_volume" released by "delete_volume" :: held 3.615s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:09:13 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7bd771f2-1ea7-4d96-80bf-dcef8ec229b3 tempest-VolumesActionsTest-825282009 None] Acquiring lock "cinder-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1-detach_volume" by "detach_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:09:13 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7bd771f2-1ea7-4d96-80bf-dcef8ec229b3 tempest-VolumesActionsTest-825282009 None] Lock "cinder-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:09:13 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-7bd771f2-1ea7-4d96-80bf-dcef8ec229b3 tempest-VolumesActionsTest-825282009 None] Detaching volume b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1 from instance 1bb35e82-4185-427b-9e49-ad588246ce95. Jul 10 18:09:13 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-7bd771f2-1ea7-4d96-80bf-dcef8ec229b3 tempest-VolumesActionsTest-825282009 None] Detach volume completed successfully. Jul 10 18:09:13 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7bd771f2-1ea7-4d96-80bf-dcef8ec229b3 tempest-VolumesActionsTest-825282009 None] Lock "cinder-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1-detach_volume" released by "detach_volume" :: held 0.082s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:09:20 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-b1043ab4-f7a5-42a6-8a9f-061ba2c1ce10 req-72206e8f-778c-4822-adc6-626230420ceb tempest-ServerActionsTestOtherA-1137861595 None] Terminate volume connection completed successfully. Jul 10 18:09:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-b1043ab4-f7a5-42a6-8a9f-061ba2c1ce10 req-72206e8f-778c-4822-adc6-626230420ceb tempest-ServerActionsTestOtherA-1137861595 None] Deleting attachment a9b0c191-b3b3-45bf-8cd9-2bd2d9a3ff50. {{(pid=87399) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 18:09:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-b1043ab4-f7a5-42a6-8a9f-061ba2c1ce10 req-22ccdcdf-aecc-4f41-aff0-742163f281d1 tempest-ServerActionsTestOtherA-1137861595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:09:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-b1043ab4-f7a5-42a6-8a9f-061ba2c1ce10 req-22ccdcdf-aecc-4f41-aff0-742163f281d1 tempest-ServerActionsTestOtherA-1137861595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:09:23 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[9500e2e0-ae17-403d-b35b-0e6442dc6b0a]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:09:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-b1043ab4-f7a5-42a6-8a9f-061ba2c1ce10 req-22ccdcdf-aecc-4f41-aff0-742163f281d1 tempest-ServerActionsTestOtherA-1137861595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d210b9e1-60c2-459e-8904-05069637a521 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:09:23 devstack sudo[91258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d210b9e1-60c2-459e-8904-05069637a521 Jul 10 18:09:23 devstack sudo[91258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:09:24 devstack sudo[91258]: pam_unix(sudo:session): session closed for user root Jul 10 18:09:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-b1043ab4-f7a5-42a6-8a9f-061ba2c1ce10 req-22ccdcdf-aecc-4f41-aff0-742163f281d1 tempest-ServerActionsTestOtherA-1137861595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d210b9e1-60c2-459e-8904-05069637a521" returned: 0 in 0.944s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:09:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-b1043ab4-f7a5-42a6-8a9f-061ba2c1ce10 req-22ccdcdf-aecc-4f41-aff0-742163f281d1 tempest-ServerActionsTestOtherA-1137861595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.977s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:09:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-b1043ab4-f7a5-42a6-8a9f-061ba2c1ce10 req-22ccdcdf-aecc-4f41-aff0-742163f281d1 tempest-ServerActionsTestOtherA-1137861595 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd', 'name': 'volume-d210b9e1-60c2-459e-8904-05069637a521', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '52fb9f8d-496a-441c-ac63-0eddb1b1ba27', 'enforce_multipath': True} {{(pid=87399) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 18:09:24 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-b1043ab4-f7a5-42a6-8a9f-061ba2c1ce10 req-22ccdcdf-aecc-4f41-aff0-742163f281d1 tempest-ServerActionsTestOtherA-1137861595 None] attachment_update completed successfully. Jul 10 18:09:25 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-a96242c9-1df2-4b30-988e-532e935ad509 tempest-GroupsTest-504761341 None] Group tempest-Group1-1352603935: creating Jul 10 18:09:25 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-a96242c9-1df2-4b30-988e-532e935ad509 tempest-GroupsTest-504761341 None] Group tempest-Group1-1352603935: created successfully Jul 10 18:09:25 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-a96242c9-1df2-4b30-988e-532e935ad509 tempest-GroupsTest-504761341 None] Create group completed successfully. Jul 10 18:09:26 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-b6dfc12c-4264-4aff-b799-fdc67f6b0cb8 tempest-GroupsTest-504761341 None] Group tempest-Group2-1191516140: creating Jul 10 18:09:26 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-b6dfc12c-4264-4aff-b799-fdc67f6b0cb8 tempest-GroupsTest-504761341 None] Group tempest-Group2-1191516140: created successfully Jul 10 18:09:26 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-b6dfc12c-4264-4aff-b799-fdc67f6b0cb8 tempest-GroupsTest-504761341 None] Create group completed successfully. Jul 10 18:09:28 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:09:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] Flow 'volume_create_manager' (1b72a2dd-37c9-4548-b6e4-cb4b1d728056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:09:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9c7b43-3659-4098-97de-b2cf439482e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:09:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9c7b43-3659-4098-97de-b2cf439482e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-877863444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c01f8b22-0d87-4dfd-abd0-bad4e2b4826a,host='devstack@QuobyteHD#QuobyteHD',id=6af8ee20-0066-4635-b7b2-35084a2c335c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47c9697a3ddc4010952880a37f84c332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:09:28Z,use_quota=True,user_id='4b19568d5602494f857e2bfc7fd82f50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec5fbd38-138a-4b40-afbf-494051a32070),volume_type_id=ec5fbd38-138a-4b40-afbf-494051a32070)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:09:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca61bd0-c196-4bec-8c94-36f19002c1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:09:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ca61bd0-c196-4bec-8c94-36f19002c1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:09:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f07d610c-9f9e-4d98-b28d-2ae681e47a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:09:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f07d610c-9f9e-4d98-b28d-2ae681e47a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6af8ee20-0066-4635-b7b2-35084a2c335c', 'volume_name': 'volume-6af8ee20-0066-4635-b7b2-35084a2c335c', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:09:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a32ec2-517f-4bbd-b6c8-55b5a028c0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:09:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a32ec2-517f-4bbd-b6c8-55b5a028c0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:09:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80020f4b-a9c8-4b2d-910a-1fcb253b454c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:09:28 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] Volume 6af8ee20-0066-4635-b7b2-35084a2c335c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6af8ee20-0066-4635-b7b2-35084a2c335c', 'volume_size': 1} Jul 10 18:09:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:09:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:09:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c01f8b22-0d87-4dfd-abd0-bad4e2b4826a,created_at=2026-07-10T16:09:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-877863444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c01f8b22-0d87-4dfd-abd0-bad4e2b4826a,host='devstack@QuobyteHD#QuobyteHD',id=6af8ee20-0066-4635-b7b2-35084a2c335c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47c9697a3ddc4010952880a37f84c332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:09:28Z,use_quota=True,user_id='4b19568d5602494f857e2bfc7fd82f50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec5fbd38-138a-4b40-afbf-494051a32070),volume_type_id=ec5fbd38-138a-4b40-afbf-494051a32070)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:09:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] Creating volume 6af8ee20-0066-4635-b7b2-35084a2c335c {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:09:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:09:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:09:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:09:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:09:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:09:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:09:28 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:09:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6af8ee20-0066-4635-b7b2-35084a2c335c 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:09:28 devstack sudo[91359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6af8ee20-0066-4635-b7b2-35084a2c335c 1073741824 Jul 10 18:09:28 devstack sudo[91359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:09:29 devstack sudo[91359]: pam_unix(sudo:session): session closed for user root Jul 10 18:09:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6af8ee20-0066-4635-b7b2-35084a2c335c 1073741824" returned: 0 in 1.541s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:09:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6af8ee20-0066-4635-b7b2-35084a2c335c {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:09:30 devstack sudo[91387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6af8ee20-0066-4635-b7b2-35084a2c335c Jul 10 18:09:30 devstack sudo[91387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:09:31 devstack sudo[91387]: pam_unix(sudo:session): session closed for user root Jul 10 18:09:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6af8ee20-0066-4635-b7b2-35084a2c335c" returned: 0 in 1.012s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:09:31 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] <== create_volume: return (2620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:09:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.624s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:09:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80020f4b-a9c8-4b2d-910a-1fcb253b454c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6af8ee20-0066-4635-b7b2-35084a2c335c', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:09:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b950bc-e6b2-4fcf-a76a-fba90e10121d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:09:31 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] Volume volume-6af8ee20-0066-4635-b7b2-35084a2c335c (6af8ee20-0066-4635-b7b2-35084a2c335c): created successfully Jul 10 18:09:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33b950bc-e6b2-4fcf-a76a-fba90e10121d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:09:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] Flow 'volume_create_manager' (1b72a2dd-37c9-4548-b6e4-cb4b1d728056) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:09:31 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-7518199b-d970-42e8-99e9-e04a2be3a119 tempest-GroupsTest-504761341 None] Created volume successfully. Jul 10 18:09:33 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2b3fa9d6-7f4d-431a-980c-a836815d23f6 tempest-GroupsTest-504761341 None] Acquiring lock "cinder-quobyte-6af8ee20-0066-4635-b7b2-35084a2c335c" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:09:33 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2b3fa9d6-7f4d-431a-980c-a836815d23f6 tempest-GroupsTest-504761341 None] Lock "cinder-quobyte-6af8ee20-0066-4635-b7b2-35084a2c335c" acquired by "delete_volume" :: waited 0.018s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:09:33 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad38395c-bc17-47f6-a8f0-147e1958016f]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:09:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2b3fa9d6-7f4d-431a-980c-a836815d23f6 tempest-GroupsTest-504761341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6af8ee20-0066-4635-b7b2-35084a2c335c {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:09:33 devstack sudo[91745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6af8ee20-0066-4635-b7b2-35084a2c335c Jul 10 18:09:33 devstack sudo[91745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:09:34 devstack sudo[91745]: pam_unix(sudo:session): session closed for user root Jul 10 18:09:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2b3fa9d6-7f4d-431a-980c-a836815d23f6 tempest-GroupsTest-504761341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6af8ee20-0066-4635-b7b2-35084a2c335c" returned: 0 in 1.358s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:09:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2b3fa9d6-7f4d-431a-980c-a836815d23f6 tempest-GroupsTest-504761341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6af8ee20-0066-4635-b7b2-35084a2c335c {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:09:34 devstack sudo[91756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6af8ee20-0066-4635-b7b2-35084a2c335c Jul 10 18:09:34 devstack sudo[91756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:09:35 devstack sudo[91756]: pam_unix(sudo:session): session closed for user root Jul 10 18:09:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2b3fa9d6-7f4d-431a-980c-a836815d23f6 tempest-GroupsTest-504761341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6af8ee20-0066-4635-b7b2-35084a2c335c" returned: 0 in 1.040s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:09:35 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2b3fa9d6-7f4d-431a-980c-a836815d23f6 tempest-GroupsTest-504761341 None] Lock "cinder-quobyte-6af8ee20-0066-4635-b7b2-35084a2c335c" released by "delete_volume" :: held 2.502s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:09:35 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-2b3fa9d6-7f4d-431a-980c-a836815d23f6 tempest-GroupsTest-504761341 None] Created reservations ['6422cff6-a93a-40ed-aee9-19e9c6213f46'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:09:35 devstack cinder-volume[87399]: WARNING cinder.quota [None req-2b3fa9d6-7f4d-431a-980c-a836815d23f6 tempest-GroupsTest-504761341 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1925839609 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1925839609, it is now deprecated. Please use the default quota class for default quota. Jul 10 18:09:35 devstack cinder-volume[87399]: WARNING cinder.quota [None req-2b3fa9d6-7f4d-431a-980c-a836815d23f6 tempest-GroupsTest-504761341 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1925839609 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1925839609, it is now deprecated. Please use the default quota class for default quota. Jul 10 18:09:35 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-2b3fa9d6-7f4d-431a-980c-a836815d23f6 tempest-GroupsTest-504761341 None] Created reservations ['8e7066f0-8056-44b7-b14c-cf4ec7905f56', '6e629230-945d-4e9b-87c6-bd91890ad0eb', '96425a61-03b8-4777-a842-c9eea3d6dfb4', '680d9e70-e60f-4243-8e7a-5bc3ba4689c4'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:09:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2b3fa9d6-7f4d-431a-980c-a836815d23f6 tempest-GroupsTest-504761341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:09:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2b3fa9d6-7f4d-431a-980c-a836815d23f6 tempest-GroupsTest-504761341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:09:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-2b3fa9d6-7f4d-431a-980c-a836815d23f6 tempest-GroupsTest-504761341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:09:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-2b3fa9d6-7f4d-431a-980c-a836815d23f6 tempest-GroupsTest-504761341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:09:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2b3fa9d6-7f4d-431a-980c-a836815d23f6 tempest-GroupsTest-504761341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:09:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2b3fa9d6-7f4d-431a-980c-a836815d23f6 tempest-GroupsTest-504761341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:09:36 devstack sudo[91799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:09:36 devstack sudo[91799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:09:36 devstack sudo[91799]: pam_unix(sudo:session): session closed for user root Jul 10 18:09:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2b3fa9d6-7f4d-431a-980c-a836815d23f6 tempest-GroupsTest-504761341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.812s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:09:36 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-2b3fa9d6-7f4d-431a-980c-a836815d23f6 tempest-GroupsTest-504761341 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:09:36 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-2b3fa9d6-7f4d-431a-980c-a836815d23f6 tempest-GroupsTest-504761341 None] Delete group completed successfully. Jul 10 18:09:37 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-0bb74ddb-63e1-4fdc-9335-e7086cc6af52 tempest-GroupsTest-504761341 None] Created reservations ['7593587d-d188-4274-b1e9-f0782ba52ff3'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:09:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0bb74ddb-63e1-4fdc-9335-e7086cc6af52 tempest-GroupsTest-504761341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:09:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0bb74ddb-63e1-4fdc-9335-e7086cc6af52 tempest-GroupsTest-504761341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:09:37 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0bb74ddb-63e1-4fdc-9335-e7086cc6af52 tempest-GroupsTest-504761341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:09:37 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0bb74ddb-63e1-4fdc-9335-e7086cc6af52 tempest-GroupsTest-504761341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:09:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0bb74ddb-63e1-4fdc-9335-e7086cc6af52 tempest-GroupsTest-504761341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:09:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0bb74ddb-63e1-4fdc-9335-e7086cc6af52 tempest-GroupsTest-504761341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:09:37 devstack sudo[91869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:09:37 devstack sudo[91869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:09:38 devstack sudo[91869]: pam_unix(sudo:session): session closed for user root Jul 10 18:09:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0bb74ddb-63e1-4fdc-9335-e7086cc6af52 tempest-GroupsTest-504761341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.755s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:09:38 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-0bb74ddb-63e1-4fdc-9335-e7086cc6af52 tempest-GroupsTest-504761341 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:09:38 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-0bb74ddb-63e1-4fdc-9335-e7086cc6af52 tempest-GroupsTest-504761341 None] Delete group completed successfully. Jul 10 18:09:39 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:UPDATE=60,cinder:SELECT=70,cinder:DELETE=5,cinder:INSERT=13 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:09:39 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-dd33326d-ac79-4366-b137-804ee10ff376 tempest-GroupsTest-504761341 None] Group tempest-GroupsTest-Group-1678867589: creating Jul 10 18:09:39 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=67,cinder:INSERT=16,cinder:UPDATE=69,cinder:DELETE=3 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:09:39 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-dd33326d-ac79-4366-b137-804ee10ff376 tempest-GroupsTest-504761341 None] Group tempest-GroupsTest-Group-1678867589: created successfully Jul 10 18:09:39 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-dd33326d-ac79-4366-b137-804ee10ff376 tempest-GroupsTest-504761341 None] Create group completed successfully. Jul 10 18:09:40 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-147da7f8-2405-49f8-a866-b5d9d25f998a tempest-VolumesActionsTest-825282009 None] Acquiring lock "cinder-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1" by "attach_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:09:40 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-147da7f8-2405-49f8-a866-b5d9d25f998a tempest-VolumesActionsTest-825282009 None] Lock "cinder-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1" acquired by "attach_volume" :: waited 0.097s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:09:40 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-147da7f8-2405-49f8-a866-b5d9d25f998a tempest-VolumesActionsTest-825282009 None] Attaching volume b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1 to instance 0b8f1443-476a-4672-a995-dde0a686730f at mountpoint /dev/vdb on host None. Jul 10 18:09:40 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-147da7f8-2405-49f8-a866-b5d9d25f998a tempest-VolumesActionsTest-825282009 None] Attach volume completed successfully. Jul 10 18:09:40 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-147da7f8-2405-49f8-a866-b5d9d25f998a tempest-VolumesActionsTest-825282009 None] Lock "cinder-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1" released by "attach_volume" :: held 0.245s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:09:41 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-994b2b2e-006d-459d-afe3-b2e8a69e19b8 tempest-VolumesActionsTest-825282009 None] Acquiring lock "cinder-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1-detach_volume" by "detach_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:09:41 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-994b2b2e-006d-459d-afe3-b2e8a69e19b8 tempest-VolumesActionsTest-825282009 None] Lock "cinder-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1-detach_volume" acquired by "detach_volume" :: waited 0.067s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:09:41 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-994b2b2e-006d-459d-afe3-b2e8a69e19b8 tempest-VolumesActionsTest-825282009 None] Detaching volume b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1 from instance 0b8f1443-476a-4672-a995-dde0a686730f. Jul 10 18:09:41 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-994b2b2e-006d-459d-afe3-b2e8a69e19b8 tempest-VolumesActionsTest-825282009 None] Detach volume completed successfully. Jul 10 18:09:41 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-994b2b2e-006d-459d-afe3-b2e8a69e19b8 tempest-VolumesActionsTest-825282009 None] Lock "cinder-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1-detach_volume" released by "detach_volume" :: held 0.111s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:09:41 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:09:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] Flow 'volume_create_manager' (15a922e2-b3c0-40b2-b757-437694c505e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:09:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79353f1d-b8aa-483d-b7f9-f6c885ed9a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:09:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79353f1d-b8aa-483d-b7f9-f6c885ed9a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1226691370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8e66106d-494c-48ee-a9b2-3b9794b2cf1d,host='devstack@QuobyteHD#QuobyteHD',id=111a4feb-2c9b-4945-9353-7306dd1a520e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47c9697a3ddc4010952880a37f84c332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:09:42Z,use_quota=True,user_id='4b19568d5602494f857e2bfc7fd82f50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc394cd9-4d37-4632-b6e1-48d8c686a525),volume_type_id=dc394cd9-4d37-4632-b6e1-48d8c686a525)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:09:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977c2466-9a3c-40cd-8b84-6df586995923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:09:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (977c2466-9a3c-40cd-8b84-6df586995923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:09:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73278185-3aba-4290-928b-91d1d4395861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:09:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73278185-3aba-4290-928b-91d1d4395861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '111a4feb-2c9b-4945-9353-7306dd1a520e', 'volume_name': 'volume-111a4feb-2c9b-4945-9353-7306dd1a520e', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:09:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9629990-9487-433e-8d63-13141c9ad07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:09:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9629990-9487-433e-8d63-13141c9ad07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:09:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc52c25e-e373-4905-83f4-291aa4da241f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:09:41 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] Volume 111a4feb-2c9b-4945-9353-7306dd1a520e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-111a4feb-2c9b-4945-9353-7306dd1a520e', 'volume_size': 1} Jul 10 18:09:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:09:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:09:41 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8e66106d-494c-48ee-a9b2-3b9794b2cf1d,created_at=2026-07-10T16:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1226691370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8e66106d-494c-48ee-a9b2-3b9794b2cf1d,host='devstack@QuobyteHD#QuobyteHD',id=111a4feb-2c9b-4945-9353-7306dd1a520e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47c9697a3ddc4010952880a37f84c332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:09:42Z,use_quota=True,user_id='4b19568d5602494f857e2bfc7fd82f50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc394cd9-4d37-4632-b6e1-48d8c686a525),volume_type_id=dc394cd9-4d37-4632-b6e1-48d8c686a525)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:09:41 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] Creating volume 111a4feb-2c9b-4945-9353-7306dd1a520e {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:09:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:09:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:09:41 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:09:41 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:09:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:09:41 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:09:41 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:09:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-111a4feb-2c9b-4945-9353-7306dd1a520e 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:09:41 devstack sudo[91883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-111a4feb-2c9b-4945-9353-7306dd1a520e 1073741824 Jul 10 18:09:41 devstack sudo[91883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:09:43 devstack sudo[91883]: pam_unix(sudo:session): session closed for user root Jul 10 18:09:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-111a4feb-2c9b-4945-9353-7306dd1a520e 1073741824" returned: 0 in 1.760s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:09:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-111a4feb-2c9b-4945-9353-7306dd1a520e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:09:43 devstack sudo[91903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-111a4feb-2c9b-4945-9353-7306dd1a520e Jul 10 18:09:43 devstack sudo[91903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:09:44 devstack sudo[91903]: pam_unix(sudo:session): session closed for user root Jul 10 18:09:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-111a4feb-2c9b-4945-9353-7306dd1a520e" returned: 0 in 0.655s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:09:44 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] <== create_volume: return (2466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:09:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.469s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:09:44 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc52c25e-e373-4905-83f4-291aa4da241f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-111a4feb-2c9b-4945-9353-7306dd1a520e', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:09:44 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (add6a4cb-6320-4008-b167-0a001df1fb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:09:44 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] Volume volume-111a4feb-2c9b-4945-9353-7306dd1a520e (111a4feb-2c9b-4945-9353-7306dd1a520e): created successfully Jul 10 18:09:44 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (add6a4cb-6320-4008-b167-0a001df1fb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:09:44 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] Flow 'volume_create_manager' (15a922e2-b3c0-40b2-b757-437694c505e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:09:44 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-b183e190-0fe6-4200-b004-23ef7fe9720c tempest-GroupsTest-504761341 None] Created volume successfully. Jul 10 18:09:46 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:09:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] Flow 'volume_create_manager' (0cdbdb9a-736a-4110-a327-b6b9624e4797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:09:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc0b13c-696d-4e48-b930-2398d3770833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:09:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc0b13c-696d-4e48-b930-2398d3770833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1050146921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8e66106d-494c-48ee-a9b2-3b9794b2cf1d,host='devstack@QuobyteHD#QuobyteHD',id=0e44dc08-894d-4461-88b3-dcbb306be138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47c9697a3ddc4010952880a37f84c332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:09:46Z,use_quota=True,user_id='4b19568d5602494f857e2bfc7fd82f50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc394cd9-4d37-4632-b6e1-48d8c686a525),volume_type_id=dc394cd9-4d37-4632-b6e1-48d8c686a525)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:09:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8503bf35-2b87-4cb0-b41f-85801c030cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:09:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8503bf35-2b87-4cb0-b41f-85801c030cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:09:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c43eeffc-bb3f-43dd-baa3-892132f50b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:09:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c43eeffc-bb3f-43dd-baa3-892132f50b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e44dc08-894d-4461-88b3-dcbb306be138', 'volume_name': 'volume-0e44dc08-894d-4461-88b3-dcbb306be138', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:09:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a62fb46-5cb1-4e4b-9d80-ed64d2bafa8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:09:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a62fb46-5cb1-4e4b-9d80-ed64d2bafa8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:09:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4175bc5e-75c1-40ec-9699-96aa938eff36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:09:46 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] Volume 0e44dc08-894d-4461-88b3-dcbb306be138: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e44dc08-894d-4461-88b3-dcbb306be138', 'volume_size': 1} Jul 10 18:09:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:09:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:09:46 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8e66106d-494c-48ee-a9b2-3b9794b2cf1d,created_at=2026-07-10T16:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1050146921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8e66106d-494c-48ee-a9b2-3b9794b2cf1d,host='devstack@QuobyteHD#QuobyteHD',id=0e44dc08-894d-4461-88b3-dcbb306be138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47c9697a3ddc4010952880a37f84c332',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:09:46Z,use_quota=True,user_id='4b19568d5602494f857e2bfc7fd82f50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc394cd9-4d37-4632-b6e1-48d8c686a525),volume_type_id=dc394cd9-4d37-4632-b6e1-48d8c686a525)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:09:46 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] Creating volume 0e44dc08-894d-4461-88b3-dcbb306be138 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:09:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:09:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:09:46 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:09:46 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:09:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:09:46 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:09:46 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:09:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0e44dc08-894d-4461-88b3-dcbb306be138 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:09:46 devstack sudo[91963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0e44dc08-894d-4461-88b3-dcbb306be138 1073741824 Jul 10 18:09:46 devstack sudo[91963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:09:47 devstack sudo[91963]: pam_unix(sudo:session): session closed for user root Jul 10 18:09:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0e44dc08-894d-4461-88b3-dcbb306be138 1073741824" returned: 0 in 1.062s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:09:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0e44dc08-894d-4461-88b3-dcbb306be138 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:09:47 devstack sudo[92003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0e44dc08-894d-4461-88b3-dcbb306be138 Jul 10 18:09:47 devstack sudo[92003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:09:48 devstack sudo[92003]: pam_unix(sudo:session): session closed for user root Jul 10 18:09:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0e44dc08-894d-4461-88b3-dcbb306be138" returned: 0 in 0.744s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:09:48 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] <== create_volume: return (1861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:09:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.864s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:09:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4175bc5e-75c1-40ec-9699-96aa938eff36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e44dc08-894d-4461-88b3-dcbb306be138', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:09:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6039eff-ad44-41c1-a70f-a68ef7b3e17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:09:48 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] Volume volume-0e44dc08-894d-4461-88b3-dcbb306be138 (0e44dc08-894d-4461-88b3-dcbb306be138): created successfully Jul 10 18:09:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6039eff-ad44-41c1-a70f-a68ef7b3e17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:09:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] Flow 'volume_create_manager' (0cdbdb9a-736a-4110-a327-b6b9624e4797) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:09:48 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-f79c5806-afa3-4471-8169-34c550c5c26b tempest-GroupsTest-504761341 None] Created volume successfully. Jul 10 18:09:49 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-d17ec39d-3252-46dd-b72a-a1c9d7b06088 tempest-GroupsTest-504761341 None] Update group completed successfully. Jul 10 18:09:50 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-e8d1f0dc-6cdd-4553-b835-c3587a3ec6ad tempest-GroupsTest-504761341 None] Update group completed successfully. Jul 10 18:09:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ed631a6e-2f51-4158-8b4f-463aa4c1eb2c tempest-VolumesActionsTest-825282009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:09:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ed631a6e-2f51-4158-8b4f-463aa4c1eb2c tempest-VolumesActionsTest-825282009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:09:51 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e6c135-7b21-4446-8083-71e654ada8e9]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:09:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ed631a6e-2f51-4158-8b4f-463aa4c1eb2c tempest-VolumesActionsTest-825282009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:09:51 devstack sudo[92066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1 Jul 10 18:09:51 devstack sudo[92066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:09:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2e3a8926-3a81-4800-a889-45cf00f82741 tempest-GroupsTest-504761341 None] Acquiring lock "cinder-quobyte-0e44dc08-894d-4461-88b3-dcbb306be138" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:09:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2e3a8926-3a81-4800-a889-45cf00f82741 tempest-GroupsTest-504761341 None] Lock "cinder-quobyte-0e44dc08-894d-4461-88b3-dcbb306be138" acquired by "delete_volume" :: waited 0.028s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:09:52 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[53606857-3d52-4764-bf32-21b270159761]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:09:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2e3a8926-3a81-4800-a889-45cf00f82741 tempest-GroupsTest-504761341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0e44dc08-894d-4461-88b3-dcbb306be138 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:09:52 devstack sudo[92066]: pam_unix(sudo:session): session closed for user root Jul 10 18:09:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ed631a6e-2f51-4158-8b4f-463aa4c1eb2c tempest-VolumesActionsTest-825282009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1" returned: 0 in 0.967s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:09:52 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[b520454d-5c67-49be-906f-ce096eec9ae1]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:09:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ed631a6e-2f51-4158-8b4f-463aa4c1eb2c tempest-VolumesActionsTest-825282009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:09:52 devstack sudo[92073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0e44dc08-894d-4461-88b3-dcbb306be138 Jul 10 18:09:52 devstack sudo[92073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:09:52 devstack sudo[92074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1 Jul 10 18:09:52 devstack sudo[92074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:09:53 devstack sudo[92073]: pam_unix(sudo:session): session closed for user root Jul 10 18:09:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2e3a8926-3a81-4800-a889-45cf00f82741 tempest-GroupsTest-504761341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0e44dc08-894d-4461-88b3-dcbb306be138" returned: 0 in 1.213s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:09:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2e3a8926-3a81-4800-a889-45cf00f82741 tempest-GroupsTest-504761341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0e44dc08-894d-4461-88b3-dcbb306be138 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:09:53 devstack sudo[92083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0e44dc08-894d-4461-88b3-dcbb306be138 Jul 10 18:09:53 devstack sudo[92083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:09:54 devstack sudo[92074]: pam_unix(sudo:session): session closed for user root Jul 10 18:09:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ed631a6e-2f51-4158-8b4f-463aa4c1eb2c tempest-VolumesActionsTest-825282009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1" returned: 0 in 1.356s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:09:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ed631a6e-2f51-4158-8b4f-463aa4c1eb2c tempest-VolumesActionsTest-825282009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1 /opt/stack/data/cinder/conversion/b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1.temp_image.1808d127-75f2-4936-a37c-d3faa0528478g84cn2vn.img {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:09:54 devstack sudo[92086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1 /opt/stack/data/cinder/conversion/b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1.temp_image.1808d127-75f2-4936-a37c-d3faa0528478g84cn2vn.img Jul 10 18:09:54 devstack sudo[92086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:09:54 devstack sudo[92083]: pam_unix(sudo:session): session closed for user root Jul 10 18:09:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2e3a8926-3a81-4800-a889-45cf00f82741 tempest-GroupsTest-504761341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0e44dc08-894d-4461-88b3-dcbb306be138" returned: 0 in 0.998s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:09:54 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2e3a8926-3a81-4800-a889-45cf00f82741 tempest-GroupsTest-504761341 None] Lock "cinder-quobyte-0e44dc08-894d-4461-88b3-dcbb306be138" released by "delete_volume" :: held 2.285s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:09:54 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2e3a8926-3a81-4800-a889-45cf00f82741 tempest-GroupsTest-504761341 None] Acquiring lock "cinder-quobyte-111a4feb-2c9b-4945-9353-7306dd1a520e" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:09:54 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2e3a8926-3a81-4800-a889-45cf00f82741 tempest-GroupsTest-504761341 None] Lock "cinder-quobyte-111a4feb-2c9b-4945-9353-7306dd1a520e" acquired by "delete_volume" :: waited 0.016s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:09:54 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[d464b7a9-a532-458d-9ac7-dad6e36459bd]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:09:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2e3a8926-3a81-4800-a889-45cf00f82741 tempest-GroupsTest-504761341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-111a4feb-2c9b-4945-9353-7306dd1a520e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:09:54 devstack sudo[92091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-111a4feb-2c9b-4945-9353-7306dd1a520e Jul 10 18:09:54 devstack sudo[92091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:09:57 devstack sudo[92091]: pam_unix(sudo:session): session closed for user root Jul 10 18:09:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2e3a8926-3a81-4800-a889-45cf00f82741 tempest-GroupsTest-504761341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-111a4feb-2c9b-4945-9353-7306dd1a520e" returned: 0 in 2.376s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:09:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2e3a8926-3a81-4800-a889-45cf00f82741 tempest-GroupsTest-504761341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-111a4feb-2c9b-4945-9353-7306dd1a520e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:09:57 devstack sudo[92111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-111a4feb-2c9b-4945-9353-7306dd1a520e Jul 10 18:09:57 devstack sudo[92111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:09:57 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:09:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:09:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:09:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:09:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:09:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:09:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:09:57 devstack sudo[92113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:09:57 devstack sudo[92113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:09:59 devstack sudo[92111]: pam_unix(sudo:session): session closed for user root Jul 10 18:09:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2e3a8926-3a81-4800-a889-45cf00f82741 tempest-GroupsTest-504761341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-111a4feb-2c9b-4945-9353-7306dd1a520e" returned: 0 in 2.249s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:09:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2e3a8926-3a81-4800-a889-45cf00f82741 tempest-GroupsTest-504761341 None] Lock "cinder-quobyte-111a4feb-2c9b-4945-9353-7306dd1a520e" released by "delete_volume" :: held 4.707s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:09:59 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-2e3a8926-3a81-4800-a889-45cf00f82741 tempest-GroupsTest-504761341 None] Created reservations ['705ec208-84bc-4f2f-87cc-2e2b01c61ab3'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:09:59 devstack cinder-volume[87399]: WARNING cinder.quota [None req-2e3a8926-3a81-4800-a889-45cf00f82741 tempest-GroupsTest-504761341 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2016811807 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2016811807, it is now deprecated. Please use the default quota class for default quota. Jul 10 18:09:59 devstack cinder-volume[87399]: WARNING cinder.quota [None req-2e3a8926-3a81-4800-a889-45cf00f82741 tempest-GroupsTest-504761341 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2016811807 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2016811807, it is now deprecated. Please use the default quota class for default quota. Jul 10 18:09:59 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-2e3a8926-3a81-4800-a889-45cf00f82741 tempest-GroupsTest-504761341 None] Created reservations ['5d37f395-1ce3-4a07-915f-40a616b2e82b', 'b96f31f2-8391-4025-b248-14103548b932', 'e7cf742c-4f14-4d9c-8998-c87a6e6adca0', '65a658a4-99f2-47f5-ac2b-91a349fd82f0'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:10:00 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-2e3a8926-3a81-4800-a889-45cf00f82741 tempest-GroupsTest-504761341 None] Created reservations ['7b466a0c-8f2b-4a5d-bf64-e4b5d5cd7471', '3042c3e8-a2aa-4bff-99b2-b7b0ee3cf195', 'e9136345-c7c2-4862-bd67-3cab8a0f22df', '1333a2f3-84d7-41f8-8d4f-9c5bd80b02db'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:10:00 devstack sudo[92113]: pam_unix(sudo:session): session closed for user root Jul 10 18:10:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 2.949s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:10:00 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:10:00 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager._thread_info {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:10:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread count: 8 {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 18:10:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread info: [<_MainThread(MainThread, started 139757428633728)>, , , , , , , ] {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 18:10:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2e3a8926-3a81-4800-a889-45cf00f82741 tempest-GroupsTest-504761341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:10:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2e3a8926-3a81-4800-a889-45cf00f82741 tempest-GroupsTest-504761341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:10:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-2e3a8926-3a81-4800-a889-45cf00f82741 tempest-GroupsTest-504761341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:10:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-2e3a8926-3a81-4800-a889-45cf00f82741 tempest-GroupsTest-504761341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:10:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2e3a8926-3a81-4800-a889-45cf00f82741 tempest-GroupsTest-504761341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:10:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2e3a8926-3a81-4800-a889-45cf00f82741 tempest-GroupsTest-504761341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:10:00 devstack sudo[92124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:10:00 devstack sudo[92124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:10:01 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-4d0d4bc1-6cdf-4ec3-931f-b9a7c7aa3944 req-40aa34f4-5bb1-4cb1-a9d4-9cf6627d61c3 tempest-ServerActionsTestOtherA-1137861595 None] Terminate volume connection completed successfully. Jul 10 18:10:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-4d0d4bc1-6cdf-4ec3-931f-b9a7c7aa3944 req-40aa34f4-5bb1-4cb1-a9d4-9cf6627d61c3 tempest-ServerActionsTestOtherA-1137861595 None] Deleting attachment 52fb9f8d-496a-441c-ac63-0eddb1b1ba27. {{(pid=87399) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 18:10:02 devstack sudo[92086]: pam_unix(sudo:session): session closed for user root Jul 10 18:10:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ed631a6e-2f51-4158-8b4f-463aa4c1eb2c tempest-VolumesActionsTest-825282009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1 /opt/stack/data/cinder/conversion/b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1.temp_image.1808d127-75f2-4936-a37c-d3faa0528478g84cn2vn.img" returned: 0 in 8.330s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:10:02 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed4872a-65cc-4925-8d13-a8e4d525047b]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:10:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ed631a6e-2f51-4158-8b4f-463aa4c1eb2c tempest-VolumesActionsTest-825282009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:10:02 devstack sudo[92124]: pam_unix(sudo:session): session closed for user root Jul 10 18:10:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2e3a8926-3a81-4800-a889-45cf00f82741 tempest-GroupsTest-504761341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.861s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:10:02 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-2e3a8926-3a81-4800-a889-45cf00f82741 tempest-GroupsTest-504761341 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:10:02 devstack sudo[92132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1 Jul 10 18:10:02 devstack sudo[92132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:10:02 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-2e3a8926-3a81-4800-a889-45cf00f82741 tempest-GroupsTest-504761341 None] Delete group completed successfully. Jul 10 18:10:03 devstack sudo[92132]: pam_unix(sudo:session): session closed for user root Jul 10 18:10:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ed631a6e-2f51-4158-8b4f-463aa4c1eb2c tempest-VolumesActionsTest-825282009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1" returned: 0 in 1.197s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:10:03 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-ed631a6e-2f51-4158-8b4f-463aa4c1eb2c tempest-VolumesActionsTest-825282009 None] Image conversion details: src /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1, size 1024.00 MB, duration 8.33 sec, destination /opt/stack/data/cinder/conversion/b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1.temp_image.1808d127-75f2-4936-a37c-d3faa0528478g84cn2vn.img {{(pid=87399) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 18:10:03 devstack cinder-volume[87399]: INFO cinder.image.image_utils [None req-ed631a6e-2f51-4158-8b4f-463aa4c1eb2c tempest-VolumesActionsTest-825282009 None] Converted 1024.00 MB image at 122.91 MB/s Jul 10 18:10:03 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-ed631a6e-2f51-4158-8b4f-463aa4c1eb2c tempest-VolumesActionsTest-825282009 None] 1808d127-75f2-4936-a37c-d3faa0528478 was raw, no need to convert to raw {{(pid=87399) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 10 18:10:07 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-0784bd76-8362-415b-994b-f8982f2c0fe7 tempest-GroupsV320Test-1856109123 None] Group tempest-GroupsV320Test-Group-1104428383: creating Jul 10 18:10:08 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-0784bd76-8362-415b-994b-f8982f2c0fe7 tempest-GroupsV320Test-1856109123 None] Group tempest-GroupsV320Test-Group-1104428383: created successfully Jul 10 18:10:08 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-0784bd76-8362-415b-994b-f8982f2c0fe7 tempest-GroupsV320Test-1856109123 None] Create group completed successfully. Jul 10 18:10:09 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-4eb49624-5609-49a0-9e3a-01a702de5ee0 tempest-GroupsV320Test-1856109123 None] Created reservations ['583eeb7d-8132-46e8-a1fe-69b95475e70c'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:10:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4eb49624-5609-49a0-9e3a-01a702de5ee0 tempest-GroupsV320Test-1856109123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:10:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4eb49624-5609-49a0-9e3a-01a702de5ee0 tempest-GroupsV320Test-1856109123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:10:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-4eb49624-5609-49a0-9e3a-01a702de5ee0 tempest-GroupsV320Test-1856109123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:10:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-4eb49624-5609-49a0-9e3a-01a702de5ee0 tempest-GroupsV320Test-1856109123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:10:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4eb49624-5609-49a0-9e3a-01a702de5ee0 tempest-GroupsV320Test-1856109123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:10:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4eb49624-5609-49a0-9e3a-01a702de5ee0 tempest-GroupsV320Test-1856109123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:10:09 devstack sudo[92207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:10:09 devstack sudo[92207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:10:10 devstack sudo[92207]: pam_unix(sudo:session): session closed for user root Jul 10 18:10:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4eb49624-5609-49a0-9e3a-01a702de5ee0 tempest-GroupsV320Test-1856109123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.773s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:10:10 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-4eb49624-5609-49a0-9e3a-01a702de5ee0 tempest-GroupsV320Test-1856109123 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:10:10 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-4eb49624-5609-49a0-9e3a-01a702de5ee0 tempest-GroupsV320Test-1856109123 None] Delete group completed successfully. Jul 10 18:10:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-35806d39-4b77-4a13-a774-923f2c16044c tempest-ServerActionsTestOtherA-1137861595 None] Acquiring lock "cinder-d210b9e1-60c2-459e-8904-05069637a521-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:10:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-35806d39-4b77-4a13-a774-923f2c16044c tempest-ServerActionsTestOtherA-1137861595 None] Lock "cinder-d210b9e1-60c2-459e-8904-05069637a521-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:10:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-35806d39-4b77-4a13-a774-923f2c16044c tempest-ServerActionsTestOtherA-1137861595 None] Acquiring lock "cinder-quobyte-d210b9e1-60c2-459e-8904-05069637a521" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:10:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-35806d39-4b77-4a13-a774-923f2c16044c tempest-ServerActionsTestOtherA-1137861595 None] Lock "cinder-quobyte-d210b9e1-60c2-459e-8904-05069637a521" acquired by "delete_volume" :: waited 0.020s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:10:12 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebc72e3-ff41-4f00-9e5a-1ad74cdac4cc]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:10:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-35806d39-4b77-4a13-a774-923f2c16044c tempest-ServerActionsTestOtherA-1137861595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d210b9e1-60c2-459e-8904-05069637a521 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:10:12 devstack sudo[92210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d210b9e1-60c2-459e-8904-05069637a521 Jul 10 18:10:12 devstack sudo[92210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:10:13 devstack sudo[92210]: pam_unix(sudo:session): session closed for user root Jul 10 18:10:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-35806d39-4b77-4a13-a774-923f2c16044c tempest-ServerActionsTestOtherA-1137861595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d210b9e1-60c2-459e-8904-05069637a521" returned: 0 in 0.896s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:10:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-35806d39-4b77-4a13-a774-923f2c16044c tempest-ServerActionsTestOtherA-1137861595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d210b9e1-60c2-459e-8904-05069637a521 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:10:13 devstack sudo[92215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d210b9e1-60c2-459e-8904-05069637a521 Jul 10 18:10:13 devstack sudo[92215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:10:14 devstack sudo[92215]: pam_unix(sudo:session): session closed for user root Jul 10 18:10:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-35806d39-4b77-4a13-a774-923f2c16044c tempest-ServerActionsTestOtherA-1137861595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d210b9e1-60c2-459e-8904-05069637a521" returned: 0 in 0.917s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:10:14 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-35806d39-4b77-4a13-a774-923f2c16044c tempest-ServerActionsTestOtherA-1137861595 None] Lock "cinder-quobyte-d210b9e1-60c2-459e-8904-05069637a521" released by "delete_volume" :: held 1.899s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:10:14 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-35806d39-4b77-4a13-a774-923f2c16044c tempest-ServerActionsTestOtherA-1137861595 None] Created reservations ['fe10004c-3215-48db-8c0d-431eddeeae04', '3d2c2baa-be78-435f-99f7-6f1fc1ebd1f8', 'b5a96ff1-4581-46e0-8d52-28fc0444a3f5', 'fea3774b-6426-4569-a99b-660d1c47d8e8'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:10:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-35806d39-4b77-4a13-a774-923f2c16044c tempest-ServerActionsTestOtherA-1137861595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:10:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-35806d39-4b77-4a13-a774-923f2c16044c tempest-ServerActionsTestOtherA-1137861595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:10:14 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-35806d39-4b77-4a13-a774-923f2c16044c tempest-ServerActionsTestOtherA-1137861595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:10:14 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-35806d39-4b77-4a13-a774-923f2c16044c tempest-ServerActionsTestOtherA-1137861595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:10:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-35806d39-4b77-4a13-a774-923f2c16044c tempest-ServerActionsTestOtherA-1137861595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:10:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-35806d39-4b77-4a13-a774-923f2c16044c tempest-ServerActionsTestOtherA-1137861595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:10:14 devstack sudo[92220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:10:14 devstack sudo[92220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:10:14 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:10:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] Flow 'volume_create_manager' (a38b7c35-667f-420a-b67b-a4f1980f4965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:10:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69fa8dd-88c0-42f1-b954-480cbd27078e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:10:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a69fa8dd-88c0-42f1-b954-480cbd27078e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1246439989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a5e2b49-c00f-4d02-9eb5-6051f33656f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf47e263f1cd414c99e98e7823e04041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:10:15Z,use_quota=True,user_id='b151d2ab246a4f0d8228abf58074b4d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:10:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c24ef904-9b58-4e8c-83a5-ca84def7cdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:10:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c24ef904-9b58-4e8c-83a5-ca84def7cdef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:10:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0617eb26-e6d9-47bd-a4ee-661fc21b35c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:10:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0617eb26-e6d9-47bd-a4ee-661fc21b35c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a5e2b49-c00f-4d02-9eb5-6051f33656f5', 'volume_name': 'volume-5a5e2b49-c00f-4d02-9eb5-6051f33656f5', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:10:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ff7976-5eba-462e-9e65-0bfda62596db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:10:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ff7976-5eba-462e-9e65-0bfda62596db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:10:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (022dec8f-fde4-43c1-a6f1-2e395a6d19fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:10:14 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] Volume 5a5e2b49-c00f-4d02-9eb5-6051f33656f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a5e2b49-c00f-4d02-9eb5-6051f33656f5', 'volume_size': 1} Jul 10 18:10:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:10:15 devstack sudo[92220]: pam_unix(sudo:session): session closed for user root Jul 10 18:10:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-35806d39-4b77-4a13-a774-923f2c16044c tempest-ServerActionsTestOtherA-1137861595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.987s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:10:15 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-35806d39-4b77-4a13-a774-923f2c16044c tempest-ServerActionsTestOtherA-1137861595 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:10:15 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-35806d39-4b77-4a13-a774-923f2c16044c tempest-ServerActionsTestOtherA-1137861595 None] Deleted volume successfully. Jul 10 18:10:15 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-35806d39-4b77-4a13-a774-923f2c16044c tempest-ServerActionsTestOtherA-1137861595 None] Lock "cinder-d210b9e1-60c2-459e-8904-05069637a521-delete_volume" released by "delete_volume" :: held 3.211s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:10:24 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:10:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Flow 'volume_create_manager' (e8b2119e-a688-46d2-a5b9-c1809abd3f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:10:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1557804-08f4-4b18-bb40-9c5f1b179724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:10:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1557804-08f4-4b18-bb40-9c5f1b179724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1876733748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7150350e-4109-48ad-b3c4-51d6423f17a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef1f3b28d20a4af399185eb26831b2e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:10:24Z,use_quota=True,user_id='62772593dc194cba8618aac5097f9abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:10:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcc6cb7d-22bc-4c26-9c78-f48857a5504c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:10:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcc6cb7d-22bc-4c26-9c78-f48857a5504c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:10:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12b77cb5-4ec3-4394-9813-66a7550e4ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:10:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12b77cb5-4ec3-4394-9813-66a7550e4ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7150350e-4109-48ad-b3c4-51d6423f17a3', 'volume_name': 'volume-7150350e-4109-48ad-b3c4-51d6423f17a3', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:10:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be6feea-1962-4d69-b8d9-458514ba0c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:10:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1be6feea-1962-4d69-b8d9-458514ba0c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:10:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b5eaab-78c5-463d-a7d0-6f743a6fe3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:10:24 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Volume 7150350e-4109-48ad-b3c4-51d6423f17a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7150350e-4109-48ad-b3c4-51d6423f17a3', 'volume_size': 1} Jul 10 18:10:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:10:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ed631a6e-2f51-4158-8b4f-463aa4c1eb2c tempest-VolumesActionsTest-825282009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 36.245s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:10:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ed631a6e-2f51-4158-8b4f-463aa4c1eb2c tempest-VolumesActionsTest-825282009 None] Uploaded volume to glance image-id: 1808d127-75f2-4936-a37c-d3faa0528478. {{(pid=87399) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 10 18:10:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.926s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:10:27 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1246439989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a5e2b49-c00f-4d02-9eb5-6051f33656f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf47e263f1cd414c99e98e7823e04041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:10:15Z,use_quota=True,user_id='b151d2ab246a4f0d8228abf58074b4d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:10:27 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] Creating volume 5a5e2b49-c00f-4d02-9eb5-6051f33656f5 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:10:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:10:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:10:27 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:10:27 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:10:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:10:27 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:10:27 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:10:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5a5e2b49-c00f-4d02-9eb5-6051f33656f5 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:10:27 devstack sudo[92267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5a5e2b49-c00f-4d02-9eb5-6051f33656f5 1073741824 Jul 10 18:10:27 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-ed631a6e-2f51-4158-8b4f-463aa4c1eb2c tempest-VolumesActionsTest-825282009 None] Copy volume to image completed successfully. Jul 10 18:10:27 devstack sudo[92267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:10:28 devstack sudo[92267]: pam_unix(sudo:session): session closed for user root Jul 10 18:10:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5a5e2b49-c00f-4d02-9eb5-6051f33656f5 1073741824" returned: 0 in 0.968s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:10:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5a5e2b49-c00f-4d02-9eb5-6051f33656f5 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:10:28 devstack sudo[92274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5a5e2b49-c00f-4d02-9eb5-6051f33656f5 Jul 10 18:10:28 devstack sudo[92274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:10:29 devstack sudo[92274]: pam_unix(sudo:session): session closed for user root Jul 10 18:10:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5a5e2b49-c00f-4d02-9eb5-6051f33656f5" returned: 0 in 0.658s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:10:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:10:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:10:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.488s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:10:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1876733748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7150350e-4109-48ad-b3c4-51d6423f17a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef1f3b28d20a4af399185eb26831b2e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:10:24Z,use_quota=True,user_id='62772593dc194cba8618aac5097f9abb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:10:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Creating volume 7150350e-4109-48ad-b3c4-51d6423f17a3 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:10:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:10:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:10:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:10:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:10:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:10:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:10:29 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:10:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7150350e-4109-48ad-b3c4-51d6423f17a3 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:10:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (022dec8f-fde4-43c1-a6f1-2e395a6d19fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a5e2b49-c00f-4d02-9eb5-6051f33656f5', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:10:29 devstack sudo[92277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7150350e-4109-48ad-b3c4-51d6423f17a3 1073741824 Jul 10 18:10:29 devstack sudo[92277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:10:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f9feb24-d557-4b01-95fc-0b124c813039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:10:29 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] Volume volume-5a5e2b49-c00f-4d02-9eb5-6051f33656f5 (5a5e2b49-c00f-4d02-9eb5-6051f33656f5): created successfully Jul 10 18:10:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f9feb24-d557-4b01-95fc-0b124c813039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:10:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] Flow 'volume_create_manager' (a38b7c35-667f-420a-b67b-a4f1980f4965) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:10:29 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-5f0be5e9-c317-4792-8895-a6bc4d220e13 tempest-AttachVolumeShelveTestJSON-1165439608 None] Created volume successfully. Jul 10 18:10:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-44f43f51-3528-497a-867b-60d01644fb75 tempest-VolumesActionsTest-825282009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:10:30 devstack sudo[92277]: pam_unix(sudo:session): session closed for user root Jul 10 18:10:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7150350e-4109-48ad-b3c4-51d6423f17a3 1073741824" returned: 0 in 0.999s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:10:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7150350e-4109-48ad-b3c4-51d6423f17a3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:10:30 devstack sudo[92284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7150350e-4109-48ad-b3c4-51d6423f17a3 Jul 10 18:10:30 devstack sudo[92284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:10:31 devstack sudo[92284]: pam_unix(sudo:session): session closed for user root Jul 10 18:10:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7150350e-4109-48ad-b3c4-51d6423f17a3" returned: 0 in 0.723s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:10:31 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:10:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:10:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-44f43f51-3528-497a-867b-60d01644fb75 tempest-VolumesActionsTest-825282009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.972s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:10:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b5eaab-78c5-463d-a7d0-6f743a6fe3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7150350e-4109-48ad-b3c4-51d6423f17a3', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:10:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a85a55d0-bf5f-4b4c-a4d9-8dfbc1d6a2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:10:31 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fe5e0e-7f8b-4203-9034-34455ee14c5e]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:10:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-44f43f51-3528-497a-867b-60d01644fb75 tempest-VolumesActionsTest-825282009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:10:31 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Volume volume-7150350e-4109-48ad-b3c4-51d6423f17a3 (7150350e-4109-48ad-b3c4-51d6423f17a3): created successfully Jul 10 18:10:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a85a55d0-bf5f-4b4c-a4d9-8dfbc1d6a2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:10:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Flow 'volume_create_manager' (e8b2119e-a688-46d2-a5b9-c1809abd3f20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:10:31 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-44341b15-ed14-41b1-9e9d-e8eaf08d2660 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Created volume successfully. Jul 10 18:10:31 devstack sudo[92291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1 Jul 10 18:10:31 devstack sudo[92291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:10:32 devstack sudo[92291]: pam_unix(sudo:session): session closed for user root Jul 10 18:10:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-44f43f51-3528-497a-867b-60d01644fb75 tempest-VolumesActionsTest-825282009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1" returned: 0 in 0.863s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:10:32 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cc46ed-10f5-48fc-93a1-7b9690f2afc9]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:10:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-44f43f51-3528-497a-867b-60d01644fb75 tempest-VolumesActionsTest-825282009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:10:32 devstack sudo[92296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1 Jul 10 18:10:32 devstack sudo[92296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:10:33 devstack sudo[92296]: pam_unix(sudo:session): session closed for user root Jul 10 18:10:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-44f43f51-3528-497a-867b-60d01644fb75 tempest-VolumesActionsTest-825282009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1" returned: 0 in 1.027s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:10:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-44f43f51-3528-497a-867b-60d01644fb75 tempest-VolumesActionsTest-825282009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1 /opt/stack/data/cinder/conversion/b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1.temp_image.3f606349-af11-4121-be1b-63bb57e36b8f0et65ibt.img {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:10:33 devstack sudo[92302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1 /opt/stack/data/cinder/conversion/b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1.temp_image.3f606349-af11-4121-be1b-63bb57e36b8f0et65ibt.img Jul 10 18:10:33 devstack sudo[92302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:10:33 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-680ad849-87d1-4fb1-974c-7fd5aab5e348 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Acquiring lock "cinder-7150350e-4109-48ad-b3c4-51d6423f17a3-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:10:33 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-680ad849-87d1-4fb1-974c-7fd5aab5e348 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Lock "cinder-7150350e-4109-48ad-b3c4-51d6423f17a3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:10:33 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-680ad849-87d1-4fb1-974c-7fd5aab5e348 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Acquiring lock "cinder-quobyte-7150350e-4109-48ad-b3c4-51d6423f17a3" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:10:33 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-680ad849-87d1-4fb1-974c-7fd5aab5e348 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Lock "cinder-quobyte-7150350e-4109-48ad-b3c4-51d6423f17a3" acquired by "delete_volume" :: waited 0.018s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:10:33 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3b0549-607b-421e-97c3-5899fed6b335]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:10:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-680ad849-87d1-4fb1-974c-7fd5aab5e348 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7150350e-4109-48ad-b3c4-51d6423f17a3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:10:34 devstack sudo[92307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7150350e-4109-48ad-b3c4-51d6423f17a3 Jul 10 18:10:34 devstack sudo[92307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:10:35 devstack sudo[92307]: pam_unix(sudo:session): session closed for user root Jul 10 18:10:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-680ad849-87d1-4fb1-974c-7fd5aab5e348 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7150350e-4109-48ad-b3c4-51d6423f17a3" returned: 0 in 1.671s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:10:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-680ad849-87d1-4fb1-974c-7fd5aab5e348 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7150350e-4109-48ad-b3c4-51d6423f17a3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:10:35 devstack sudo[92327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7150350e-4109-48ad-b3c4-51d6423f17a3 Jul 10 18:10:35 devstack sudo[92327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:10:36 devstack sudo[92327]: pam_unix(sudo:session): session closed for user root Jul 10 18:10:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-680ad849-87d1-4fb1-974c-7fd5aab5e348 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7150350e-4109-48ad-b3c4-51d6423f17a3" returned: 0 in 1.318s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:10:37 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-680ad849-87d1-4fb1-974c-7fd5aab5e348 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Lock "cinder-quobyte-7150350e-4109-48ad-b3c4-51d6423f17a3" released by "delete_volume" :: held 3.073s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:10:37 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-680ad849-87d1-4fb1-974c-7fd5aab5e348 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Created reservations ['1b2b0353-5bf7-4063-a63f-1b813b22dacc', 'bb261113-d64b-4f14-91fd-72e73209233a', 'c6199d08-3ff7-4aed-95ec-5408dad97224', '03cbf5ca-7261-4b1b-88cc-d24fa0466192'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:10:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-680ad849-87d1-4fb1-974c-7fd5aab5e348 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:10:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-680ad849-87d1-4fb1-974c-7fd5aab5e348 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:10:37 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-680ad849-87d1-4fb1-974c-7fd5aab5e348 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:10:37 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-680ad849-87d1-4fb1-974c-7fd5aab5e348 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:10:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-680ad849-87d1-4fb1-974c-7fd5aab5e348 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:10:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-680ad849-87d1-4fb1-974c-7fd5aab5e348 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:10:37 devstack sudo[92338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:10:37 devstack sudo[92338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:10:39 devstack sudo[92338]: pam_unix(sudo:session): session closed for user root Jul 10 18:10:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-680ad849-87d1-4fb1-974c-7fd5aab5e348 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 2.327s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:10:39 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-680ad849-87d1-4fb1-974c-7fd5aab5e348 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:10:39 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-680ad849-87d1-4fb1-974c-7fd5aab5e348 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Deleted volume successfully. Jul 10 18:10:39 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=45,cinder:UPDATE=52,cinder:INSERT=13,cinder:DELETE=3 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:10:39 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-680ad849-87d1-4fb1-974c-7fd5aab5e348 tempest-VolumeQuotasNegativeTestJSON-1859994664 None] Lock "cinder-7150350e-4109-48ad-b3c4-51d6423f17a3-delete_volume" released by "delete_volume" :: held 5.979s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:10:40 devstack sudo[92302]: pam_unix(sudo:session): session closed for user root Jul 10 18:10:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-44f43f51-3528-497a-867b-60d01644fb75 tempest-VolumesActionsTest-825282009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1 /opt/stack/data/cinder/conversion/b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1.temp_image.3f606349-af11-4121-be1b-63bb57e36b8f0et65ibt.img" returned: 0 in 6.704s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:10:40 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba25f68-9e88-42b8-99fe-321fe4572113]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:10:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-44f43f51-3528-497a-867b-60d01644fb75 tempest-VolumesActionsTest-825282009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:10:40 devstack sudo[92378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1 Jul 10 18:10:40 devstack sudo[92378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:10:41 devstack sudo[92378]: pam_unix(sudo:session): session closed for user root Jul 10 18:10:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-44f43f51-3528-497a-867b-60d01644fb75 tempest-VolumesActionsTest-825282009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1" returned: 0 in 1.236s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:10:41 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-44f43f51-3528-497a-867b-60d01644fb75 tempest-VolumesActionsTest-825282009 None] Image conversion details: src /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1, size 1024.00 MB, duration 6.71 sec, destination /opt/stack/data/cinder/conversion/b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1.temp_image.3f606349-af11-4121-be1b-63bb57e36b8f0et65ibt.img {{(pid=87399) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 18:10:41 devstack cinder-volume[87399]: INFO cinder.image.image_utils [None req-44f43f51-3528-497a-867b-60d01644fb75 tempest-VolumesActionsTest-825282009 None] Converted 1024.00 MB image at 152.70 MB/s Jul 10 18:10:41 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:UPDATE=61,cinder:INSERT=11,cinder:SELECT=60,cinder:DELETE=3 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:10:41 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-44f43f51-3528-497a-867b-60d01644fb75 tempest-VolumesActionsTest-825282009 None] 3f606349-af11-4121-be1b-63bb57e36b8f was raw, converting to qcow2 {{(pid=87399) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 10 18:10:41 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a4a644-dd61-465c-a6bc-64da35d61e77]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:10:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-44f43f51-3528-497a-867b-60d01644fb75 tempest-VolumesActionsTest-825282009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1.temp_image.3f606349-af11-4121-be1b-63bb57e36b8f0et65ibt.img {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:10:41 devstack sudo[92383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1.temp_image.3f606349-af11-4121-be1b-63bb57e36b8f0et65ibt.img Jul 10 18:10:41 devstack sudo[92383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:10:42 devstack sudo[92383]: pam_unix(sudo:session): session closed for user root Jul 10 18:10:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-44f43f51-3528-497a-867b-60d01644fb75 tempest-VolumesActionsTest-825282009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1.temp_image.3f606349-af11-4121-be1b-63bb57e36b8f0et65ibt.img" returned: 0 in 1.093s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:10:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-44f43f51-3528-497a-867b-60d01644fb75 tempest-VolumesActionsTest-825282009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1.temp_image.3f606349-af11-4121-be1b-63bb57e36b8f0et65ibt.img {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:10:42 devstack sudo[92387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1.temp_image.3f606349-af11-4121-be1b-63bb57e36b8f0et65ibt.img Jul 10 18:10:42 devstack sudo[92387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:10:43 devstack sudo[92387]: pam_unix(sudo:session): session closed for user root Jul 10 18:10:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-44f43f51-3528-497a-867b-60d01644fb75 tempest-VolumesActionsTest-825282009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1.temp_image.3f606349-af11-4121-be1b-63bb57e36b8f0et65ibt.img" returned: 1 in 0.987s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:10:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-44f43f51-3528-497a-867b-60d01644fb75 tempest-VolumesActionsTest-825282009 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1.temp_image.3f606349-af11-4121-be1b-63bb57e36b8f0et65ibt.img' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:10:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-44f43f51-3528-497a-867b-60d01644fb75 tempest-VolumesActionsTest-825282009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1.temp_image.3f606349-af11-4121-be1b-63bb57e36b8f0et65ibt.img /opt/stack/data/cinder/conversion/vol_upload_k6dj9ok7 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:10:43 devstack sudo[92392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1.temp_image.3f606349-af11-4121-be1b-63bb57e36b8f0et65ibt.img /opt/stack/data/cinder/conversion/vol_upload_k6dj9ok7 Jul 10 18:10:43 devstack sudo[92392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:10:44 devstack sudo[92392]: pam_unix(sudo:session): session closed for user root Jul 10 18:10:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-44f43f51-3528-497a-867b-60d01644fb75 tempest-VolumesActionsTest-825282009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1.temp_image.3f606349-af11-4121-be1b-63bb57e36b8f0et65ibt.img /opt/stack/data/cinder/conversion/vol_upload_k6dj9ok7" returned: 0 in 0.707s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:10:44 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-44f43f51-3528-497a-867b-60d01644fb75 tempest-VolumesActionsTest-825282009 None] Image conversion details: src /opt/stack/data/cinder/conversion/b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1.temp_image.3f606349-af11-4121-be1b-63bb57e36b8f0et65ibt.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_k6dj9ok7 {{(pid=87399) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 18:10:44 devstack cinder-volume[87399]: INFO cinder.image.image_utils [None req-44f43f51-3528-497a-867b-60d01644fb75 tempest-VolumesActionsTest-825282009 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 10 18:10:44 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9c5c48-a9b7-4fd0-bfda-79b9d3eee488]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:10:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-44f43f51-3528-497a-867b-60d01644fb75 tempest-VolumesActionsTest-825282009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_k6dj9ok7 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:10:44 devstack sudo[92397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_k6dj9ok7 Jul 10 18:10:44 devstack sudo[92397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:10:44 devstack sudo[92397]: pam_unix(sudo:session): session closed for user root Jul 10 18:10:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-44f43f51-3528-497a-867b-60d01644fb75 tempest-VolumesActionsTest-825282009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_k6dj9ok7" returned: 0 in 0.852s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:10:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-44f43f51-3528-497a-867b-60d01644fb75 tempest-VolumesActionsTest-825282009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 16.196s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:10:47 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-44f43f51-3528-497a-867b-60d01644fb75 tempest-VolumesActionsTest-825282009 None] Uploaded volume to glance image-id: 3f606349-af11-4121-be1b-63bb57e36b8f. {{(pid=87399) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 10 18:10:47 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-44f43f51-3528-497a-867b-60d01644fb75 tempest-VolumesActionsTest-825282009 None] Copy volume to image completed successfully. Jul 10 18:10:49 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a81d28e8-61ed-42f7-8ef4-d3bcef8eef9b tempest-VolumesActionsTest-825282009 None] Acquiring lock "cinder-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:10:49 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a81d28e8-61ed-42f7-8ef4-d3bcef8eef9b tempest-VolumesActionsTest-825282009 None] Lock "cinder-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:10:49 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a81d28e8-61ed-42f7-8ef4-d3bcef8eef9b tempest-VolumesActionsTest-825282009 None] Acquiring lock "cinder-quobyte-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:10:49 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a81d28e8-61ed-42f7-8ef4-d3bcef8eef9b tempest-VolumesActionsTest-825282009 None] Lock "cinder-quobyte-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1" acquired by "delete_volume" :: waited 0.020s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:10:49 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[4721548a-a6d1-40fb-89d7-2d8e64e24419]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:10:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a81d28e8-61ed-42f7-8ef4-d3bcef8eef9b tempest-VolumesActionsTest-825282009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:10:49 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:10:49 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Flow 'volume_create_manager' (80d3fc07-2ab6-48f3-8522-adb59a138208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:10:49 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d84b6d8f-3d55-49bc-9eb8-eaede91fd989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:10:49 devstack sudo[92427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1 Jul 10 18:10:49 devstack sudo[92427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:10:49 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d84b6d8f-3d55-49bc-9eb8-eaede91fd989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1088647130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7e057ba-e64c-4892-b7d8-4c6b29a20125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a38050760fa45ac94382dc6282253bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:10:49Z,use_quota=True,user_id='94fecadc1f85484399b27b0efcf3b59f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9b63aee-a140-4143-ba5d-cb3a8b1bf3ec),volume_type_id=d9b63aee-a140-4143-ba5d-cb3a8b1bf3ec)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:10:49 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad3bcf1-4417-4b2d-a7d5-7e5eb159270e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:10:49 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad3bcf1-4417-4b2d-a7d5-7e5eb159270e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:10:49 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e8d0e02-f44d-4342-9681-1932bad6d8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:10:49 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e8d0e02-f44d-4342-9681-1932bad6d8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7e057ba-e64c-4892-b7d8-4c6b29a20125', 'volume_name': 'volume-b7e057ba-e64c-4892-b7d8-4c6b29a20125', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:10:49 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d64ac84-3de1-49f8-90fd-4cd5b788690c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:10:49 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d64ac84-3de1-49f8-90fd-4cd5b788690c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:10:49 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22a46b56-38dc-4ad1-8aa3-d1e8c71d582c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:10:49 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Volume b7e057ba-e64c-4892-b7d8-4c6b29a20125: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7e057ba-e64c-4892-b7d8-4c6b29a20125', 'volume_size': 1} Jul 10 18:10:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:10:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:10:49 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:10:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1088647130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7e057ba-e64c-4892-b7d8-4c6b29a20125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a38050760fa45ac94382dc6282253bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:10:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:10:49Z,use_quota=True,user_id='94fecadc1f85484399b27b0efcf3b59f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9b63aee-a140-4143-ba5d-cb3a8b1bf3ec),volume_type_id=d9b63aee-a140-4143-ba5d-cb3a8b1bf3ec)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:10:49 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Creating volume b7e057ba-e64c-4892-b7d8-4c6b29a20125 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:10:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:10:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:10:49 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:10:49 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:10:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:10:49 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:10:49 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:10:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b7e057ba-e64c-4892-b7d8-4c6b29a20125 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:10:49 devstack sudo[92429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b7e057ba-e64c-4892-b7d8-4c6b29a20125 1073741824 Jul 10 18:10:49 devstack sudo[92429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:10:50 devstack sudo[92427]: pam_unix(sudo:session): session closed for user root Jul 10 18:10:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a81d28e8-61ed-42f7-8ef4-d3bcef8eef9b tempest-VolumesActionsTest-825282009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1" returned: 0 in 0.949s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:10:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a81d28e8-61ed-42f7-8ef4-d3bcef8eef9b tempest-VolumesActionsTest-825282009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:10:50 devstack sudo[92440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1 Jul 10 18:10:50 devstack sudo[92440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:10:50 devstack sudo[92429]: pam_unix(sudo:session): session closed for user root Jul 10 18:10:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b7e057ba-e64c-4892-b7d8-4c6b29a20125 1073741824" returned: 0 in 1.013s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:10:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b7e057ba-e64c-4892-b7d8-4c6b29a20125 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:10:50 devstack sudo[92443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b7e057ba-e64c-4892-b7d8-4c6b29a20125 Jul 10 18:10:50 devstack sudo[92443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:10:51 devstack sudo[92440]: pam_unix(sudo:session): session closed for user root Jul 10 18:10:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a81d28e8-61ed-42f7-8ef4-d3bcef8eef9b tempest-VolumesActionsTest-825282009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1" returned: 0 in 0.827s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:10:51 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a81d28e8-61ed-42f7-8ef4-d3bcef8eef9b tempest-VolumesActionsTest-825282009 None] Lock "cinder-quobyte-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1" released by "delete_volume" :: held 1.835s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:10:51 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-39798fee-ce83-4d36-bbb9-2b67148a2b39 req-a206066d-9f5d-4a03-87b9-e4fe112f5128 tempest-AttachVolumeShelveTestJSON-1165439608 None] No connector for attachment 67d84065-d548-4df0-a4fd-81cd4bb63a64; skipping storage backend terminate_connection call. {{(pid=87399) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 10 18:10:51 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-39798fee-ce83-4d36-bbb9-2b67148a2b39 req-a206066d-9f5d-4a03-87b9-e4fe112f5128 tempest-AttachVolumeShelveTestJSON-1165439608 None] Deleting attachment 67d84065-d548-4df0-a4fd-81cd4bb63a64. {{(pid=87399) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 18:10:51 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-a81d28e8-61ed-42f7-8ef4-d3bcef8eef9b tempest-VolumesActionsTest-825282009 None] Created reservations ['5419b5e0-fd06-4a6b-8550-e7daac86ba5d', '070ff3d9-282d-4c21-956a-b37ade0cef00', '324302b7-4a2a-4700-9373-e710673bfd76', '47622a2d-5f9f-485b-8e5c-4b2a7200c2c4'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:10:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a81d28e8-61ed-42f7-8ef4-d3bcef8eef9b tempest-VolumesActionsTest-825282009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:10:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a81d28e8-61ed-42f7-8ef4-d3bcef8eef9b tempest-VolumesActionsTest-825282009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:10:51 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a81d28e8-61ed-42f7-8ef4-d3bcef8eef9b tempest-VolumesActionsTest-825282009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:10:51 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a81d28e8-61ed-42f7-8ef4-d3bcef8eef9b tempest-VolumesActionsTest-825282009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:10:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a81d28e8-61ed-42f7-8ef4-d3bcef8eef9b tempest-VolumesActionsTest-825282009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:10:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a81d28e8-61ed-42f7-8ef4-d3bcef8eef9b tempest-VolumesActionsTest-825282009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:10:51 devstack sudo[92447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:10:51 devstack sudo[92447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:10:51 devstack sudo[92443]: pam_unix(sudo:session): session closed for user root Jul 10 18:10:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b7e057ba-e64c-4892-b7d8-4c6b29a20125" returned: 0 in 0.904s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:10:51 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] <== create_volume: return (1964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:10:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.967s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:10:51 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22a46b56-38dc-4ad1-8aa3-d1e8c71d582c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7e057ba-e64c-4892-b7d8-4c6b29a20125', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:10:51 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c93b144-ec38-4c01-a347-ab6be2cfd244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:10:51 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Volume volume-b7e057ba-e64c-4892-b7d8-4c6b29a20125 (b7e057ba-e64c-4892-b7d8-4c6b29a20125): created successfully Jul 10 18:10:51 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c93b144-ec38-4c01-a347-ab6be2cfd244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:10:51 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Flow 'volume_create_manager' (80d3fc07-2ab6-48f3-8522-adb59a138208) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:10:51 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-e954156d-df37-4c16-ad2e-ba03ccdb11bc tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Created volume successfully. Jul 10 18:10:52 devstack sudo[92447]: pam_unix(sudo:session): session closed for user root Jul 10 18:10:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a81d28e8-61ed-42f7-8ef4-d3bcef8eef9b tempest-VolumesActionsTest-825282009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.699s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:10:52 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-a81d28e8-61ed-42f7-8ef4-d3bcef8eef9b tempest-VolumesActionsTest-825282009 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:10:52 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-a81d28e8-61ed-42f7-8ef4-d3bcef8eef9b tempest-VolumesActionsTest-825282009 None] Deleted volume successfully. Jul 10 18:10:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a81d28e8-61ed-42f7-8ef4-d3bcef8eef9b tempest-VolumesActionsTest-825282009 None] Lock "cinder-b4ebe66e-f7e3-47f8-8fb0-4dee6855cee1-delete_volume" released by "delete_volume" :: held 2.846s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:10:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0e3ef7ec-9d31-4e9e-8daa-5b7d00904fb9 tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:10:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0e3ef7ec-9d31-4e9e-8daa-5b7d00904fb9 tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:10:53 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0e3ef7ec-9d31-4e9e-8daa-5b7d00904fb9 tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:10:53 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0e3ef7ec-9d31-4e9e-8daa-5b7d00904fb9 tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:10:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0e3ef7ec-9d31-4e9e-8daa-5b7d00904fb9 tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:10:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0e3ef7ec-9d31-4e9e-8daa-5b7d00904fb9 tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:10:53 devstack sudo[92455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:10:53 devstack sudo[92455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:10:53 devstack sudo[92455]: pam_unix(sudo:session): session closed for user root Jul 10 18:10:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0e3ef7ec-9d31-4e9e-8daa-5b7d00904fb9 tempest-VolumeRetypeWithoutMigrationTest-295837779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.770s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:10:53 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-0e3ef7ec-9d31-4e9e-8daa-5b7d00904fb9 tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:10:53 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-0e3ef7ec-9d31-4e9e-8daa-5b7d00904fb9 tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Retype volume completed successfully. Jul 10 18:10:54 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a5aa4185-269b-4bec-a8c9-202312bf2345 tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Acquiring lock "cinder-b7e057ba-e64c-4892-b7d8-4c6b29a20125-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:10:54 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a5aa4185-269b-4bec-a8c9-202312bf2345 tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Lock "cinder-b7e057ba-e64c-4892-b7d8-4c6b29a20125-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:10:54 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a5aa4185-269b-4bec-a8c9-202312bf2345 tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Acquiring lock "cinder-quobyte-b7e057ba-e64c-4892-b7d8-4c6b29a20125" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:10:54 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a5aa4185-269b-4bec-a8c9-202312bf2345 tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Lock "cinder-quobyte-b7e057ba-e64c-4892-b7d8-4c6b29a20125" acquired by "delete_volume" :: waited 0.020s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:10:54 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2505d7a-d71b-432a-8b8a-b21bfa3c7fcb]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:10:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a5aa4185-269b-4bec-a8c9-202312bf2345 tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b7e057ba-e64c-4892-b7d8-4c6b29a20125 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:10:54 devstack sudo[92459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b7e057ba-e64c-4892-b7d8-4c6b29a20125 Jul 10 18:10:54 devstack sudo[92459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:10:55 devstack sudo[92459]: pam_unix(sudo:session): session closed for user root Jul 10 18:10:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a5aa4185-269b-4bec-a8c9-202312bf2345 tempest-VolumeRetypeWithoutMigrationTest-295837779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b7e057ba-e64c-4892-b7d8-4c6b29a20125" returned: 0 in 1.073s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:10:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a5aa4185-269b-4bec-a8c9-202312bf2345 tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b7e057ba-e64c-4892-b7d8-4c6b29a20125 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:10:55 devstack sudo[92467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b7e057ba-e64c-4892-b7d8-4c6b29a20125 Jul 10 18:10:55 devstack sudo[92467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:10:56 devstack sudo[92467]: pam_unix(sudo:session): session closed for user root Jul 10 18:10:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a5aa4185-269b-4bec-a8c9-202312bf2345 tempest-VolumeRetypeWithoutMigrationTest-295837779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b7e057ba-e64c-4892-b7d8-4c6b29a20125" returned: 0 in 0.848s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:10:56 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a5aa4185-269b-4bec-a8c9-202312bf2345 tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Lock "cinder-quobyte-b7e057ba-e64c-4892-b7d8-4c6b29a20125" released by "delete_volume" :: held 1.980s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:10:56 devstack cinder-volume[87399]: WARNING cinder.quota [None req-a5aa4185-269b-4bec-a8c9-202312bf2345 tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 10 18:10:56 devstack cinder-volume[87399]: WARNING cinder.quota [None req-a5aa4185-269b-4bec-a8c9-202312bf2345 tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 10 18:10:56 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-a5aa4185-269b-4bec-a8c9-202312bf2345 tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Created reservations ['4b914d71-3766-49b1-965f-26d3d5be9f45', '45787668-743f-47fa-a8f4-0cb620c8edf8', 'ed024ced-7f90-4dbe-a556-c508bdc1c029', '1c0f40a3-24bf-4ca0-a4e3-678514d8db5c'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:10:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a5aa4185-269b-4bec-a8c9-202312bf2345 tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:10:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a5aa4185-269b-4bec-a8c9-202312bf2345 tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:10:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a5aa4185-269b-4bec-a8c9-202312bf2345 tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:10:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a5aa4185-269b-4bec-a8c9-202312bf2345 tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:10:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a5aa4185-269b-4bec-a8c9-202312bf2345 tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:10:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a5aa4185-269b-4bec-a8c9-202312bf2345 tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:10:56 devstack sudo[92486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:10:56 devstack sudo[92486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:10:57 devstack sudo[92486]: pam_unix(sudo:session): session closed for user root Jul 10 18:10:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a5aa4185-269b-4bec-a8c9-202312bf2345 tempest-VolumeRetypeWithoutMigrationTest-295837779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.852s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:10:57 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-a5aa4185-269b-4bec-a8c9-202312bf2345 tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:10:57 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-a5aa4185-269b-4bec-a8c9-202312bf2345 tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Deleted volume successfully. Jul 10 18:10:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a5aa4185-269b-4bec-a8c9-202312bf2345 tempest-VolumeRetypeWithoutMigrationTest-295837779 None] Lock "cinder-b7e057ba-e64c-4892-b7d8-4c6b29a20125-delete_volume" released by "delete_volume" :: held 3.121s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:10:57 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:10:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:10:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:10:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:10:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:10:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:10:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:10:57 devstack sudo[92491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:10:57 devstack sudo[92491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:10:58 devstack sudo[92491]: pam_unix(sudo:session): session closed for user root Jul 10 18:10:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.929s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:10:58 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:10:59 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:10:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Flow 'volume_create_manager' (e8130c9c-9cf6-4d40-b741-45aca0c54d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:10:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d39fe6a2-82cf-46d5-9b0b-2a328223d310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:10:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d39fe6a2-82cf-46d5-9b0b-2a328223d310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1118960489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42087cf3-3bc1-4e59-b348-86f5e72e3442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee83425e5e134dc7966d2e6f64a06e17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:11:00Z,use_quota=True,user_id='c38605fde0704d69b8eba430d5947624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:10:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98f14aa-67cf-46bc-ac0b-adf6bc8849a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:10:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98f14aa-67cf-46bc-ac0b-adf6bc8849a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:10:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e583b0-82a1-4baa-8d97-addb341e296e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:10:59 devstack cinder-volume[87399]: DEBUG cinder.image.glance [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Creating Keystone auth plugin from conf {{(pid=87399) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 18:11:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e583b0-82a1-4baa-8d97-addb341e296e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '42087cf3-3bc1-4e59-b348-86f5e72e3442', 'volume_name': 'volume-42087cf3-3bc1-4e59-b348-86f5e72e3442', 'volume_size': 1, 'image_id': '54228e05-a815-461c-8a75-0cdb9dee188c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54228e05-a815-461c-8a75-0cdb9dee188c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3cf5ba5785934cbfaf52674b9cb542ec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '54228e05-a815-461c-8a75-0cdb9dee188c', 'created_at': datetime.datetime(2026, 7, 10, 16, 0, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 16, 0, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54228e05-a815-461c-8a75-0cdb9dee188c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d2bbd25-4439-4f28-8ce7-8a177d557a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d2bbd25-4439-4f28-8ce7-8a177d557a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b22cd07-5a1d-4d93-a0e5-c6d377e6eea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:00 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Volume 42087cf3-3bc1-4e59-b348-86f5e72e3442: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-42087cf3-3bc1-4e59-b348-86f5e72e3442', 'volume_size': 1, 'image_id': '54228e05-a815-461c-8a75-0cdb9dee188c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54228e05-a815-461c-8a75-0cdb9dee188c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3cf5ba5785934cbfaf52674b9cb542ec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '54228e05-a815-461c-8a75-0cdb9dee188c', 'created_at': datetime.datetime(2026, 7, 10, 16, 0, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 16, 0, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54228e05-a815-461c-8a75-0cdb9dee188c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 18:11:00 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Trying to clone 42087cf3-3bc1-4e59-b348-86f5e72e3442 from image 54228e05-a815-461c-8a75-0cdb9dee188c at location (None, [{'url': 'file:///opt/stack/data/glance/images/54228e05-a815-461c-8a75-0cdb9dee188c', 'metadata': {}}]). {{(pid=87399) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 18:11:01 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_mfun0r3jdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87399) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 18:11:01 devstack cinder-volume[87399]: INFO cinder.image.image_utils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Image download 20.69 MB at 20.69 MB/s Jul 10 18:11:01 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[503ddf66-7670-4251-b9be-ef6c66560f6f]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:11:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_mfun0r3jdevstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:01 devstack sudo[92549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_mfun0r3jdevstack@QuobyteHD Jul 10 18:11:01 devstack sudo[92549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:02 devstack sudo[92549]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_mfun0r3jdevstack@QuobyteHD" returned: 0 in 0.902s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:02 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Temporary image 54228e05-a815-461c-8a75-0cdb9dee188c is fetched for user c38605fde0704d69b8eba430d5947624. {{(pid=87399) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 18:11:02 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bd72f2-efce-415d-aa8d-bb8567207c35]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:11:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_mfun0r3jdevstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:02 devstack sudo[92574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_mfun0r3jdevstack@QuobyteHD Jul 10 18:11:02 devstack sudo[92574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:03 devstack sudo[92574]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_mfun0r3jdevstack@QuobyteHD" returned: 0 in 0.931s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:11:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:11:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1118960489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42087cf3-3bc1-4e59-b348-86f5e72e3442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee83425e5e134dc7966d2e6f64a06e17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:11:00Z,use_quota=True,user_id='c38605fde0704d69b8eba430d5947624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:11:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Creating volume 42087cf3-3bc1-4e59-b348-86f5e72e3442 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:11:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:11:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:11:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:11:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:11:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:11:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:11:03 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:11:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:03 devstack sudo[92582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442 1073741824 Jul 10 18:11:03 devstack sudo[92582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:04 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:11:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] Flow 'volume_create_manager' (ea31a895-9919-4a41-bcc2-1740dd97cd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:11:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0103d482-8dc1-41e1-802e-fd984ac8ec92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:05 devstack sudo[92582]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0103d482-8dc1-41e1-802e-fd984ac8ec92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-525845825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a1fbb28-6c3e-4807-8d70-7000d5389264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='899f1ef4a01542a2b151a1649749b387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:11:05Z,use_quota=True,user_id='07b1aaf66d4748cab66ab2b9640a3ca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (560737c0-8da1-4315-9d21-61ae64c70c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (560737c0-8da1-4315-9d21-61ae64c70c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a370e50-50dd-4510-8b0f-c84da3635ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a370e50-50dd-4510-8b0f-c84da3635ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a1fbb28-6c3e-4807-8d70-7000d5389264', 'volume_name': 'volume-5a1fbb28-6c3e-4807-8d70-7000d5389264', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e43ff6c-5c4b-4648-9f56-f927b42d1abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e43ff6c-5c4b-4648-9f56-f927b42d1abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12c556d2-2264-46e4-8d0b-eb453f19dcb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:05 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] Volume 5a1fbb28-6c3e-4807-8d70-7000d5389264: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a1fbb28-6c3e-4807-8d70-7000d5389264', 'volume_size': 1} Jul 10 18:11:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:11:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442 1073741824" returned: 0 in 1.917s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:05 devstack sudo[92589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442 Jul 10 18:11:05 devstack sudo[92589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:06 devstack sudo[92589]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442" returned: 0 in 0.866s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] <== create_volume: return (2864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:11:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.867s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:11:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.933s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:11:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-525845825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a1fbb28-6c3e-4807-8d70-7000d5389264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='899f1ef4a01542a2b151a1649749b387',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:11:05Z,use_quota=True,user_id='07b1aaf66d4748cab66ab2b9640a3ca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:11:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] Creating volume 5a1fbb28-6c3e-4807-8d70-7000d5389264 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:11:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:11:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:11:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:11:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:11:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:11:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:11:06 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:11:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5a1fbb28-6c3e-4807-8d70-7000d5389264 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:06 devstack sudo[92602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5a1fbb28-6c3e-4807-8d70-7000d5389264 1073741824 Jul 10 18:11:06 devstack sudo[92602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:06 devstack cinder-volume[87399]: DEBUG cinder.volume.volume_utils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Attempting download of 54228e05-a815-461c-8a75-0cdb9dee188c ((None, [{'url': 'file:///opt/stack/data/glance/images/54228e05-a815-461c-8a75-0cdb9dee188c', 'metadata': {}}])) to volume 42087cf3-3bc1-4e59-b348-86f5e72e3442. {{(pid=87399) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 18:11:06 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6f4b73-312b-4295-813e-34a25bc03c2d]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:11:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54228e05-a815-461c-8a75-0cdb9dee188c_jrygvy4q {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:06 devstack sudo[92605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54228e05-a815-461c-8a75-0cdb9dee188c_jrygvy4q Jul 10 18:11:06 devstack sudo[92605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:07 devstack sudo[92605]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54228e05-a815-461c-8a75-0cdb9dee188c_jrygvy4q" returned: 0 in 1.161s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54228e05-a815-461c-8a75-0cdb9dee188c_jrygvy4q {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:07 devstack sudo[92602]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5a1fbb28-6c3e-4807-8d70-7000d5389264 1073741824" returned: 0 in 1.402s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5a1fbb28-6c3e-4807-8d70-7000d5389264 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:07 devstack sudo[92631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5a1fbb28-6c3e-4807-8d70-7000d5389264 Jul 10 18:11:07 devstack sudo[92631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:07 devstack sudo[92630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54228e05-a815-461c-8a75-0cdb9dee188c_jrygvy4q Jul 10 18:11:07 devstack sudo[92630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:08 devstack sudo[92631]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5a1fbb28-6c3e-4807-8d70-7000d5389264" returned: 0 in 0.943s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] <== create_volume: return (2398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:11:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.401s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:11:08 devstack sudo[92630]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12c556d2-2264-46e4-8d0b-eb453f19dcb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a1fbb28-6c3e-4807-8d70-7000d5389264', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (576b30ee-e490-4477-b64a-8c921fcdd97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54228e05-a815-461c-8a75-0cdb9dee188c_jrygvy4q" returned: 1 in 1.119s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54228e05-a815-461c-8a75-0cdb9dee188c_jrygvy4q' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:11:08 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[746e7f71-acae-428b-93ed-005c9d6bdfcc]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:11:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_mfun0r3jdevstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:08 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] Volume volume-5a1fbb28-6c3e-4807-8d70-7000d5389264 (5a1fbb28-6c3e-4807-8d70-7000d5389264): created successfully Jul 10 18:11:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (576b30ee-e490-4477-b64a-8c921fcdd97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] Flow 'volume_create_manager' (ea31a895-9919-4a41-bcc2-1740dd97cd5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:11:08 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-8be8739c-d3b5-4809-84ac-ab8bf0ae62cf tempest-VolumesServicesTestJSON-958355128 None] Created volume successfully. Jul 10 18:11:08 devstack sudo[92650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_mfun0r3jdevstack@QuobyteHD Jul 10 18:11:08 devstack sudo[92650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:09 devstack sudo[92650]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_mfun0r3jdevstack@QuobyteHD" returned: 0 in 0.959s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:09 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] 54228e05-a815-461c-8a75-0cdb9dee188c was qcow2, converting to raw {{(pid=87399) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 18:11:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_mfun0r3jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:09 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-35a391eb-c22f-4894-b002-4a5c549ee47b tempest-VolumesServicesTestJSON-958355128 None] Acquiring lock "cinder-5a1fbb28-6c3e-4807-8d70-7000d5389264-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:11:09 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-35a391eb-c22f-4894-b002-4a5c549ee47b tempest-VolumesServicesTestJSON-958355128 None] Lock "cinder-5a1fbb28-6c3e-4807-8d70-7000d5389264-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:11:09 devstack sudo[92656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_mfun0r3jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442 Jul 10 18:11:09 devstack sudo[92656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:09 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-35a391eb-c22f-4894-b002-4a5c549ee47b tempest-VolumesServicesTestJSON-958355128 None] Acquiring lock "cinder-quobyte-5a1fbb28-6c3e-4807-8d70-7000d5389264" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:11:09 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-35a391eb-c22f-4894-b002-4a5c549ee47b tempest-VolumesServicesTestJSON-958355128 None] Lock "cinder-quobyte-5a1fbb28-6c3e-4807-8d70-7000d5389264" acquired by "delete_volume" :: waited 0.039s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:11:09 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed834ca-9e6b-4f85-bfd9-89b7d1929c0f]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:11:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-35a391eb-c22f-4894-b002-4a5c549ee47b tempest-VolumesServicesTestJSON-958355128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5a1fbb28-6c3e-4807-8d70-7000d5389264 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:09 devstack sudo[92658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5a1fbb28-6c3e-4807-8d70-7000d5389264 Jul 10 18:11:09 devstack sudo[92658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:10 devstack sudo[92658]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-35a391eb-c22f-4894-b002-4a5c549ee47b tempest-VolumesServicesTestJSON-958355128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5a1fbb28-6c3e-4807-8d70-7000d5389264" returned: 0 in 1.223s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-35a391eb-c22f-4894-b002-4a5c549ee47b tempest-VolumesServicesTestJSON-958355128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5a1fbb28-6c3e-4807-8d70-7000d5389264 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:10 devstack sudo[92669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5a1fbb28-6c3e-4807-8d70-7000d5389264 Jul 10 18:11:10 devstack sudo[92669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:12 devstack sudo[92669]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-35a391eb-c22f-4894-b002-4a5c549ee47b tempest-VolumesServicesTestJSON-958355128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5a1fbb28-6c3e-4807-8d70-7000d5389264" returned: 0 in 1.100s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-35a391eb-c22f-4894-b002-4a5c549ee47b tempest-VolumesServicesTestJSON-958355128 None] Lock "cinder-quobyte-5a1fbb28-6c3e-4807-8d70-7000d5389264" released by "delete_volume" :: held 2.439s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:11:12 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-35a391eb-c22f-4894-b002-4a5c549ee47b tempest-VolumesServicesTestJSON-958355128 None] Created reservations ['09f42409-6f9b-4888-8937-a3599c02839e', '46888188-cb50-4444-862e-1fcf2a9e6539', '23e62c6d-034f-4ff3-b778-7f96e90a9aa3', 'c8032a90-8302-4b59-b09d-1b554328a430'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:11:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-35a391eb-c22f-4894-b002-4a5c549ee47b tempest-VolumesServicesTestJSON-958355128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:11:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-35a391eb-c22f-4894-b002-4a5c549ee47b tempest-VolumesServicesTestJSON-958355128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:11:12 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-35a391eb-c22f-4894-b002-4a5c549ee47b tempest-VolumesServicesTestJSON-958355128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:11:12 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-35a391eb-c22f-4894-b002-4a5c549ee47b tempest-VolumesServicesTestJSON-958355128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:11:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-35a391eb-c22f-4894-b002-4a5c549ee47b tempest-VolumesServicesTestJSON-958355128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:11:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-35a391eb-c22f-4894-b002-4a5c549ee47b tempest-VolumesServicesTestJSON-958355128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:12 devstack sudo[92708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:11:12 devstack sudo[92708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:12 devstack sudo[92656]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_mfun0r3jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442" returned: 0 in 3.204s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:12 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_mfun0r3jdevstack@QuobyteHD, size 112.00 MB, duration 3.21 sec, destination /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442 {{(pid=87399) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 18:11:12 devstack cinder-volume[87399]: INFO cinder.image.image_utils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Converted 112.00 MB image at 34.94 MB/s Jul 10 18:11:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:12 devstack sudo[92717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442 1G Jul 10 18:11:12 devstack sudo[92717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:14 devstack sudo[92708]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-35a391eb-c22f-4894-b002-4a5c549ee47b tempest-VolumesServicesTestJSON-958355128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.747s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:14 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-35a391eb-c22f-4894-b002-4a5c549ee47b tempest-VolumesServicesTestJSON-958355128 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:11:14 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-35a391eb-c22f-4894-b002-4a5c549ee47b tempest-VolumesServicesTestJSON-958355128 None] Deleted volume successfully. Jul 10 18:11:14 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-35a391eb-c22f-4894-b002-4a5c549ee47b tempest-VolumesServicesTestJSON-958355128 None] Lock "cinder-5a1fbb28-6c3e-4807-8d70-7000d5389264-delete_volume" released by "delete_volume" :: held 4.707s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:11:14 devstack sudo[92717]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442 1G" returned: 0 in 1.950s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:14 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7e9d0d-9acc-4bda-8274-2d95b0aac115]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:11:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:14 devstack sudo[92748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442 Jul 10 18:11:14 devstack sudo[92748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:16 devstack sudo[92748]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442" returned: 0 in 1.883s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:16 devstack sudo[92791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442 Jul 10 18:11:16 devstack sudo[92791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:17 devstack sudo[92791]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442" returned: 1 in 1.234s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:11:17 devstack cinder-volume[87399]: DEBUG cinder.volume.volume_utils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Downloaded image 54228e05-a815-461c-8a75-0cdb9dee188c ((None, [{'url': 'file:///opt/stack/data/glance/images/54228e05-a815-461c-8a75-0cdb9dee188c', 'metadata': {}}])) to volume 42087cf3-3bc1-4e59-b348-86f5e72e3442 successfully. {{(pid=87399) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 18:11:17 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Temporary image 54228e05-a815-461c-8a75-0cdb9dee188c for user c38605fde0704d69b8eba430d5947624 is deleted. {{(pid=87399) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 18:11:17 devstack cinder-volume[87399]: DEBUG cinder.volume.volume_utils [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Marking volume 42087cf3-3bc1-4e59-b348-86f5e72e3442 as bootable. {{(pid=87399) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 18:11:17 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Copying metadata from image 54228e05-a815-461c-8a75-0cdb9dee188c to 42087cf3-3bc1-4e59-b348-86f5e72e3442. {{(pid=87399) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 18:11:17 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Creating volume glance metadata for volume 42087cf3-3bc1-4e59-b348-86f5e72e3442 backed by image 54228e05-a815-461c-8a75-0cdb9dee188c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '54228e05-a815-461c-8a75-0cdb9dee188c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87399) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 18:11:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b22cd07-5a1d-4d93-a0e5-c6d377e6eea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42087cf3-3bc1-4e59-b348-86f5e72e3442', 'volume_size': 1, 'image_id': '54228e05-a815-461c-8a75-0cdb9dee188c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54228e05-a815-461c-8a75-0cdb9dee188c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3cf5ba5785934cbfaf52674b9cb542ec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '54228e05-a815-461c-8a75-0cdb9dee188c', 'created_at': datetime.datetime(2026, 7, 10, 16, 0, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 16, 0, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54228e05-a815-461c-8a75-0cdb9dee188c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9329494d-73ea-49c0-afc2-c575724ba66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:18 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Volume volume-42087cf3-3bc1-4e59-b348-86f5e72e3442 (42087cf3-3bc1-4e59-b348-86f5e72e3442): created successfully Jul 10 18:11:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9329494d-73ea-49c0-afc2-c575724ba66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Flow 'volume_create_manager' (e8130c9c-9cf6-4d40-b741-45aca0c54d2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:11:18 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-c8428077-459d-4970-9552-1c504fe1c71d tempest-VolumesExtendTest-1606581106 None] Created volume successfully. Jul 10 18:11:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1b72f1e2-d2eb-4e80-80c3-78a0f1f70977 tempest-VolumesExtendTest-1606581106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:11:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1b72f1e2-d2eb-4e80-80c3-78a0f1f70977 tempest-VolumesExtendTest-1606581106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:11:19 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4359dd5-aa99-4cfb-b4b7-03f2556d0371]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:11:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1b72f1e2-d2eb-4e80-80c3-78a0f1f70977 tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:19 devstack sudo[92797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442 Jul 10 18:11:19 devstack sudo[92797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:19 devstack sudo[92797]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1b72f1e2-d2eb-4e80-80c3-78a0f1f70977 tempest-VolumesExtendTest-1606581106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442" returned: 0 in 0.758s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1b72f1e2-d2eb-4e80-80c3-78a0f1f70977 tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:20 devstack sudo[92801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442 Jul 10 18:11:20 devstack sudo[92801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:20 devstack sudo[92801]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1b72f1e2-d2eb-4e80-80c3-78a0f1f70977 tempest-VolumesExtendTest-1606581106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442" returned: 1 in 0.957s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1b72f1e2-d2eb-4e80-80c3-78a0f1f70977 tempest-VolumesExtendTest-1606581106 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:11:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1b72f1e2-d2eb-4e80-80c3-78a0f1f70977 tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442 2G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1b72f1e2-d2eb-4e80-80c3-78a0f1f70977 tempest-VolumesExtendTest-1606581106 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442 2G" returned: 0 in 0.073s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1b72f1e2-d2eb-4e80-80c3-78a0f1f70977 tempest-VolumesExtendTest-1606581106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.842s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:11:21 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-1b72f1e2-d2eb-4e80-80c3-78a0f1f70977 tempest-VolumesExtendTest-1606581106 None] Extend volume completed successfully. Jul 10 18:11:21 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2bdb1dab-1f4f-47e0-84f3-c52d1038d0f8 tempest-VolumesExtendTest-1606581106 None] Acquiring lock "cinder-42087cf3-3bc1-4e59-b348-86f5e72e3442-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:11:21 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2bdb1dab-1f4f-47e0-84f3-c52d1038d0f8 tempest-VolumesExtendTest-1606581106 None] Lock "cinder-42087cf3-3bc1-4e59-b348-86f5e72e3442-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:11:21 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2bdb1dab-1f4f-47e0-84f3-c52d1038d0f8 tempest-VolumesExtendTest-1606581106 None] Acquiring lock "cinder-quobyte-42087cf3-3bc1-4e59-b348-86f5e72e3442" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:11:22 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2bdb1dab-1f4f-47e0-84f3-c52d1038d0f8 tempest-VolumesExtendTest-1606581106 None] Lock "cinder-quobyte-42087cf3-3bc1-4e59-b348-86f5e72e3442" acquired by "delete_volume" :: waited 0.071s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:11:22 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c130115-600f-4d06-b94e-f983663c3f1b]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:11:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2bdb1dab-1f4f-47e0-84f3-c52d1038d0f8 tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:22 devstack sudo[92825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442 Jul 10 18:11:22 devstack sudo[92825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:23 devstack sudo[92825]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2bdb1dab-1f4f-47e0-84f3-c52d1038d0f8 tempest-VolumesExtendTest-1606581106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442" returned: 0 in 1.671s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2bdb1dab-1f4f-47e0-84f3-c52d1038d0f8 tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:24 devstack sudo[92860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442 Jul 10 18:11:24 devstack sudo[92860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:24 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:11:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] Flow 'volume_create_manager' (15108169-4a0e-42bc-ab1f-ab163c7baf2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:11:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcdbac5c-02d1-4dd4-946a-442c025f366b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcdbac5c-02d1-4dd4-946a-442c025f366b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-824482754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d7a4c44-e3ad-4c82-bb2a-fe8a21db4dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d847b38f963f441b9f14494ec0ecd2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:11:24Z,use_quota=True,user_id='5a7897eeee4b4c99821df7ae8032d09d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c4e28-3fed-48e5-83e3-bd458c6eb706),volume_type_id=d55c4e28-3fed-48e5-83e3-bd458c6eb706)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f76cb51-60c8-4a6d-aabd-ba0f9ae0dcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f76cb51-60c8-4a6d-aabd-ba0f9ae0dcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (381e49cf-8f04-4e2c-8d3f-d16ee8962a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (381e49cf-8f04-4e2c-8d3f-d16ee8962a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d7a4c44-e3ad-4c82-bb2a-fe8a21db4dce', 'volume_name': 'volume-7d7a4c44-e3ad-4c82-bb2a-fe8a21db4dce', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9216373d-ed56-4ac5-b835-1787d48c290c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9216373d-ed56-4ac5-b835-1787d48c290c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2508455b-b31a-467a-84d1-7521ffc103b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:24 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] Volume 7d7a4c44-e3ad-4c82-bb2a-fe8a21db4dce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d7a4c44-e3ad-4c82-bb2a-fe8a21db4dce', 'volume_size': 1} Jul 10 18:11:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:11:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:11:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-824482754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d7a4c44-e3ad-4c82-bb2a-fe8a21db4dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d847b38f963f441b9f14494ec0ecd2de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:11:24Z,use_quota=True,user_id='5a7897eeee4b4c99821df7ae8032d09d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d55c4e28-3fed-48e5-83e3-bd458c6eb706),volume_type_id=d55c4e28-3fed-48e5-83e3-bd458c6eb706)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:11:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] Creating volume 7d7a4c44-e3ad-4c82-bb2a-fe8a21db4dce {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:11:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:11:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:11:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:11:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:11:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:11:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:11:24 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:11:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7d7a4c44-e3ad-4c82-bb2a-fe8a21db4dce 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:24 devstack sudo[92875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7d7a4c44-e3ad-4c82-bb2a-fe8a21db4dce 1073741824 Jul 10 18:11:24 devstack sudo[92875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:25 devstack sudo[92860]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2bdb1dab-1f4f-47e0-84f3-c52d1038d0f8 tempest-VolumesExtendTest-1606581106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442" returned: 1 in 1.224s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2bdb1dab-1f4f-47e0-84f3-c52d1038d0f8 tempest-VolumesExtendTest-1606581106 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:11:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2bdb1dab-1f4f-47e0-84f3-c52d1038d0f8 tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:25 devstack sudo[92880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442 Jul 10 18:11:25 devstack sudo[92880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:25 devstack sudo[92880]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2bdb1dab-1f4f-47e0-84f3-c52d1038d0f8 tempest-VolumesExtendTest-1606581106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42087cf3-3bc1-4e59-b348-86f5e72e3442" returned: 0 in 0.774s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:25 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2bdb1dab-1f4f-47e0-84f3-c52d1038d0f8 tempest-VolumesExtendTest-1606581106 None] Lock "cinder-quobyte-42087cf3-3bc1-4e59-b348-86f5e72e3442" released by "delete_volume" :: held 3.831s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:11:25 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-2bdb1dab-1f4f-47e0-84f3-c52d1038d0f8 tempest-VolumesExtendTest-1606581106 None] Created reservations ['094240aa-93b8-461b-a125-790bdae1dc1b', '793e54c5-0aba-45e8-bef7-612159bd7f9c', '76c0a455-5064-4a50-ac9e-e7767df39b86', '0994f46b-d0eb-40bb-a52a-8c4eddb505b3'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:11:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2bdb1dab-1f4f-47e0-84f3-c52d1038d0f8 tempest-VolumesExtendTest-1606581106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:11:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2bdb1dab-1f4f-47e0-84f3-c52d1038d0f8 tempest-VolumesExtendTest-1606581106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:11:26 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-2bdb1dab-1f4f-47e0-84f3-c52d1038d0f8 tempest-VolumesExtendTest-1606581106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:11:26 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-2bdb1dab-1f4f-47e0-84f3-c52d1038d0f8 tempest-VolumesExtendTest-1606581106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:11:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2bdb1dab-1f4f-47e0-84f3-c52d1038d0f8 tempest-VolumesExtendTest-1606581106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:11:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2bdb1dab-1f4f-47e0-84f3-c52d1038d0f8 tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:26 devstack sudo[92875]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7d7a4c44-e3ad-4c82-bb2a-fe8a21db4dce 1073741824" returned: 0 in 1.343s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:26 devstack sudo[92888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:11:26 devstack sudo[92888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7d7a4c44-e3ad-4c82-bb2a-fe8a21db4dce {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:26 devstack sudo[92890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7d7a4c44-e3ad-4c82-bb2a-fe8a21db4dce Jul 10 18:11:26 devstack sudo[92890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:27 devstack sudo[92888]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2bdb1dab-1f4f-47e0-84f3-c52d1038d0f8 tempest-VolumesExtendTest-1606581106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.189s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:27 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-2bdb1dab-1f4f-47e0-84f3-c52d1038d0f8 tempest-VolumesExtendTest-1606581106 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:11:27 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-2bdb1dab-1f4f-47e0-84f3-c52d1038d0f8 tempest-VolumesExtendTest-1606581106 None] Deleted volume successfully. Jul 10 18:11:27 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2bdb1dab-1f4f-47e0-84f3-c52d1038d0f8 tempest-VolumesExtendTest-1606581106 None] Lock "cinder-42087cf3-3bc1-4e59-b348-86f5e72e3442-delete_volume" released by "delete_volume" :: held 5.501s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:11:27 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:11:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] Flow 'volume_create_manager' (328c42eb-db36-475e-9c44-50e66eff71d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:11:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb0d570-6d12-4310-b86f-9b52c3aac131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb0d570-6d12-4310-b86f-9b52c3aac131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1272070557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49572ba1-2b3e-4821-a42f-6630ce39d0d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee83425e5e134dc7966d2e6f64a06e17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:11:27Z,use_quota=True,user_id='c38605fde0704d69b8eba430d5947624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ff3cb4-aed6-4c92-8a98-136acd7700a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50ff3cb4-aed6-4c92-8a98-136acd7700a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18c5acb1-0624-4217-b3ae-78d751949fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18c5acb1-0624-4217-b3ae-78d751949fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49572ba1-2b3e-4821-a42f-6630ce39d0d2', 'volume_name': 'volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b4f7bf-c405-47c2-b075-f0883a79511b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:27 devstack sudo[92890]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b4f7bf-c405-47c2-b075-f0883a79511b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4dd240-0df5-4dc8-9bb9-7bf3db2a11bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:27 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] Volume 49572ba1-2b3e-4821-a42f-6630ce39d0d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2', 'volume_size': 1} Jul 10 18:11:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:11:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7d7a4c44-e3ad-4c82-bb2a-fe8a21db4dce" returned: 0 in 1.512s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:27 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] <== create_volume: return (2925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:11:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.929s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:11:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:11:27 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1272070557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49572ba1-2b3e-4821-a42f-6630ce39d0d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee83425e5e134dc7966d2e6f64a06e17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:11:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:11:27Z,use_quota=True,user_id='c38605fde0704d69b8eba430d5947624',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:11:27 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] Creating volume 49572ba1-2b3e-4821-a42f-6630ce39d0d2 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:11:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:11:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:11:27 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:11:27 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:11:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:11:27 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:11:27 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:11:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:27 devstack sudo[92894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2 1073741824 Jul 10 18:11:27 devstack sudo[92894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2508455b-b31a-467a-84d1-7521ffc103b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d7a4c44-e3ad-4c82-bb2a-fe8a21db4dce', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (017d253e-e443-4f71-bb2a-035db5603950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:27 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] Volume volume-7d7a4c44-e3ad-4c82-bb2a-fe8a21db4dce (7d7a4c44-e3ad-4c82-bb2a-fe8a21db4dce): created successfully Jul 10 18:11:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (017d253e-e443-4f71-bb2a-035db5603950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] Flow 'volume_create_manager' (15108169-4a0e-42bc-ab1f-ab163c7baf2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:11:27 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-6d6bb14c-0adc-46e3-988f-f5e49b990107 tempest-VolumeTypesAccessTest-66088250 None] Created volume successfully. Jul 10 18:11:28 devstack sudo[92894]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2 1073741824" returned: 0 in 1.179s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:28 devstack sudo[92901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2 Jul 10 18:11:28 devstack sudo[92901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-117fb019-4e6e-4250-8c45-0cb94377ec15 tempest-VolumeTypesAccessTest-66088250 None] Acquiring lock "cinder-7d7a4c44-e3ad-4c82-bb2a-fe8a21db4dce-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:11:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-117fb019-4e6e-4250-8c45-0cb94377ec15 tempest-VolumeTypesAccessTest-66088250 None] Lock "cinder-7d7a4c44-e3ad-4c82-bb2a-fe8a21db4dce-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:11:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-117fb019-4e6e-4250-8c45-0cb94377ec15 tempest-VolumeTypesAccessTest-66088250 None] Acquiring lock "cinder-quobyte-7d7a4c44-e3ad-4c82-bb2a-fe8a21db4dce" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:11:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-117fb019-4e6e-4250-8c45-0cb94377ec15 tempest-VolumeTypesAccessTest-66088250 None] Lock "cinder-quobyte-7d7a4c44-e3ad-4c82-bb2a-fe8a21db4dce" acquired by "delete_volume" :: waited 0.025s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:11:29 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd060e7-c5f9-41ae-b33f-6313a0841392]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:11:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-117fb019-4e6e-4250-8c45-0cb94377ec15 tempest-VolumeTypesAccessTest-66088250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7d7a4c44-e3ad-4c82-bb2a-fe8a21db4dce {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:29 devstack sudo[92903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7d7a4c44-e3ad-4c82-bb2a-fe8a21db4dce Jul 10 18:11:29 devstack sudo[92903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:29 devstack sudo[92901]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2" returned: 0 in 0.708s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] <== create_volume: return (1946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:11:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.948s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:11:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db4dd240-0df5-4dc8-9bb9-7bf3db2a11bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c9a4b4-7035-46d0-8f65-8d88cccb82d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:29 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] Volume volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2 (49572ba1-2b3e-4821-a42f-6630ce39d0d2): created successfully Jul 10 18:11:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c9a4b4-7035-46d0-8f65-8d88cccb82d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] Flow 'volume_create_manager' (328c42eb-db36-475e-9c44-50e66eff71d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:11:29 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-3f8c6137-4698-48dc-8b8d-3a2887ec1723 tempest-VolumesExtendTest-1606581106 None] Created volume successfully. Jul 10 18:11:29 devstack sudo[92903]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-117fb019-4e6e-4250-8c45-0cb94377ec15 tempest-VolumeTypesAccessTest-66088250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7d7a4c44-e3ad-4c82-bb2a-fe8a21db4dce" returned: 0 in 0.839s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-117fb019-4e6e-4250-8c45-0cb94377ec15 tempest-VolumeTypesAccessTest-66088250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7d7a4c44-e3ad-4c82-bb2a-fe8a21db4dce {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:29 devstack sudo[92914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7d7a4c44-e3ad-4c82-bb2a-fe8a21db4dce Jul 10 18:11:29 devstack sudo[92914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:30 devstack sudo[92914]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-117fb019-4e6e-4250-8c45-0cb94377ec15 tempest-VolumeTypesAccessTest-66088250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7d7a4c44-e3ad-4c82-bb2a-fe8a21db4dce" returned: 0 in 0.725s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:30 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-117fb019-4e6e-4250-8c45-0cb94377ec15 tempest-VolumeTypesAccessTest-66088250 None] Lock "cinder-quobyte-7d7a4c44-e3ad-4c82-bb2a-fe8a21db4dce" released by "delete_volume" :: held 1.607s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:11:30 devstack cinder-volume[87399]: WARNING cinder.quota [None req-117fb019-4e6e-4250-8c45-0cb94377ec15 tempest-VolumeTypesAccessTest-66088250 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-721256493 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-721256493, it is now deprecated. Please use the default quota class for default quota. Jul 10 18:11:30 devstack cinder-volume[87399]: WARNING cinder.quota [None req-117fb019-4e6e-4250-8c45-0cb94377ec15 tempest-VolumeTypesAccessTest-66088250 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-721256493 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-721256493, it is now deprecated. Please use the default quota class for default quota. Jul 10 18:11:30 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-117fb019-4e6e-4250-8c45-0cb94377ec15 tempest-VolumeTypesAccessTest-66088250 None] Created reservations ['f4ed716a-4a69-4d85-b618-3edfd0583fde', '5d6eb037-1320-43af-b97c-3271bd04592a', 'd3fb93c7-90cb-4bad-b154-cf36154b6b03', '8860fb8b-491f-4d20-a22c-78e401459855'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:11:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-117fb019-4e6e-4250-8c45-0cb94377ec15 tempest-VolumeTypesAccessTest-66088250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:11:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-117fb019-4e6e-4250-8c45-0cb94377ec15 tempest-VolumeTypesAccessTest-66088250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:11:30 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-117fb019-4e6e-4250-8c45-0cb94377ec15 tempest-VolumeTypesAccessTest-66088250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:11:30 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-117fb019-4e6e-4250-8c45-0cb94377ec15 tempest-VolumeTypesAccessTest-66088250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:11:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-117fb019-4e6e-4250-8c45-0cb94377ec15 tempest-VolumeTypesAccessTest-66088250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:11:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-117fb019-4e6e-4250-8c45-0cb94377ec15 tempest-VolumeTypesAccessTest-66088250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:30 devstack sudo[92937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:11:30 devstack sudo[92937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c5db4ef9-6a9e-4c75-935d-ab0daf4f5e06 tempest-VolumesExtendTest-1606581106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:11:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c5db4ef9-6a9e-4c75-935d-ab0daf4f5e06 tempest-VolumesExtendTest-1606581106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:11:31 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-c5db4ef9-6a9e-4c75-935d-ab0daf4f5e06 tempest-VolumesExtendTest-1606581106 None] Creating offline snapshot 2ffc1712-4327-44cf-a84b-c72da4e329d5 of volume 49572ba1-2b3e-4821-a42f-6630ce39d0d2 {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:11:31 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc6e605-ef77-4e95-b9a9-69e9c58bf3cb]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:11:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c5db4ef9-6a9e-4c75-935d-ab0daf4f5e06 tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:31 devstack sudo[92939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2 Jul 10 18:11:31 devstack sudo[92939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:31 devstack sudo[92937]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-117fb019-4e6e-4250-8c45-0cb94377ec15 tempest-VolumeTypesAccessTest-66088250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.832s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:31 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-117fb019-4e6e-4250-8c45-0cb94377ec15 tempest-VolumeTypesAccessTest-66088250 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:11:31 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-117fb019-4e6e-4250-8c45-0cb94377ec15 tempest-VolumeTypesAccessTest-66088250 None] Deleted volume successfully. Jul 10 18:11:31 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-117fb019-4e6e-4250-8c45-0cb94377ec15 tempest-VolumeTypesAccessTest-66088250 None] Lock "cinder-7d7a4c44-e3ad-4c82-bb2a-fe8a21db4dce-delete_volume" released by "delete_volume" :: held 2.712s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:11:31 devstack sudo[92939]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c5db4ef9-6a9e-4c75-935d-ab0daf4f5e06 tempest-VolumesExtendTest-1606581106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2" returned: 0 in 0.902s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c5db4ef9-6a9e-4c75-935d-ab0daf4f5e06 tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2.2ffc1712-4327-44cf-a84b-c72da4e329d5 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:32 devstack sudo[92947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2.2ffc1712-4327-44cf-a84b-c72da4e329d5 1G Jul 10 18:11:32 devstack sudo[92947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:32 devstack sudo[92947]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c5db4ef9-6a9e-4c75-935d-ab0daf4f5e06 tempest-VolumesExtendTest-1606581106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2.2ffc1712-4327-44cf-a84b-c72da4e329d5 1G" returned: 0 in 0.818s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c5db4ef9-6a9e-4c75-935d-ab0daf4f5e06 tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2.2ffc1712-4327-44cf-a84b-c72da4e329d5 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:32 devstack sudo[92953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2.2ffc1712-4327-44cf-a84b-c72da4e329d5 Jul 10 18:11:32 devstack sudo[92953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:33 devstack sudo[92953]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c5db4ef9-6a9e-4c75-935d-ab0daf4f5e06 tempest-VolumesExtendTest-1606581106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2.2ffc1712-4327-44cf-a84b-c72da4e329d5" returned: 0 in 0.744s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:33 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-c5db4ef9-6a9e-4c75-935d-ab0daf4f5e06 tempest-VolumesExtendTest-1606581106 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2.2ffc1712-4327-44cf-a84b-c72da4e329d5 is being set with open permissions: ugo+rw Jul 10 18:11:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c5db4ef9-6a9e-4c75-935d-ab0daf4f5e06 tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2.2ffc1712-4327-44cf-a84b-c72da4e329d5 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:33 devstack sudo[92958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2.2ffc1712-4327-44cf-a84b-c72da4e329d5 Jul 10 18:11:33 devstack sudo[92958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:34 devstack sudo[92958]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c5db4ef9-6a9e-4c75-935d-ab0daf4f5e06 tempest-VolumesExtendTest-1606581106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2.2ffc1712-4327-44cf-a84b-c72da4e329d5" returned: 0 in 0.738s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c5db4ef9-6a9e-4c75-935d-ab0daf4f5e06 tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:34 devstack sudo[92961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2.info Jul 10 18:11:34 devstack sudo[92961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:35 devstack sudo[92961]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c5db4ef9-6a9e-4c75-935d-ab0daf4f5e06 tempest-VolumesExtendTest-1606581106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2.info" returned: 0 in 0.724s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:35 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-c5db4ef9-6a9e-4c75-935d-ab0daf4f5e06 tempest-VolumesExtendTest-1606581106 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2.info is being set with open permissions: ugo+rw Jul 10 18:11:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c5db4ef9-6a9e-4c75-935d-ab0daf4f5e06 tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:35 devstack sudo[92964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2.info Jul 10 18:11:35 devstack sudo[92964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:35 devstack sudo[92964]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c5db4ef9-6a9e-4c75-935d-ab0daf4f5e06 tempest-VolumesExtendTest-1606581106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2.info" returned: 0 in 0.853s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c5db4ef9-6a9e-4c75-935d-ab0daf4f5e06 tempest-VolumesExtendTest-1606581106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.883s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:11:35 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-c5db4ef9-6a9e-4c75-935d-ab0daf4f5e06 tempest-VolumesExtendTest-1606581106 None] Create snapshot completed successfully Jul 10 18:11:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-17994dc8-8bdf-448d-9f64-cb630a72474c tempest-VolumesExtendTest-1606581106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:11:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-17994dc8-8bdf-448d-9f64-cb630a72474c tempest-VolumesExtendTest-1606581106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:11:36 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14ebf09-8398-48ee-a439-0cd66ac1837c]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:11:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-17994dc8-8bdf-448d-9f64-cb630a72474c tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:36 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:11:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] Flow 'volume_create_manager' (a32ac376-5484-431f-828f-a1c249792e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:11:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8112c0f7-997a-4d50-b7dd-9f3772880ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8112c0f7-997a-4d50-b7dd-9f3772880ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-178473845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c49feaa6-fa86-475b-b769-3029830bd294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c29e0335ce794aeda72d1faa959b9d40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:11:37Z,use_quota=True,user_id='abd62709f40049bf8a69c18c38d4fdd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1d9c891-29d2-4750-a4a0-28ea3bc580c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1d9c891-29d2-4750-a4a0-28ea3bc580c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e77ba1-01d3-4ac2-9582-06d5bee6e32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e77ba1-01d3-4ac2-9582-06d5bee6e32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c49feaa6-fa86-475b-b769-3029830bd294', 'volume_name': 'volume-c49feaa6-fa86-475b-b769-3029830bd294', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:36 devstack sudo[92971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2 Jul 10 18:11:36 devstack sudo[92971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb6143e3-bf67-4245-983b-61dd721ab7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb6143e3-bf67-4245-983b-61dd721ab7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a148a8d3-8bd1-4bb5-9346-2ba5bcf4066c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:36 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] Volume c49feaa6-fa86-475b-b769-3029830bd294: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c49feaa6-fa86-475b-b769-3029830bd294', 'volume_size': 1} Jul 10 18:11:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:11:37 devstack sudo[92971]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-17994dc8-8bdf-448d-9f64-cb630a72474c tempest-VolumesExtendTest-1606581106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2" returned: 0 in 0.804s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-17994dc8-8bdf-448d-9f64-cb630a72474c tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2.2ffc1712-4327-44cf-a84b-c72da4e329d5 2G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-17994dc8-8bdf-448d-9f64-cb630a72474c tempest-VolumesExtendTest-1606581106 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2.2ffc1712-4327-44cf-a84b-c72da4e329d5 2G" returned: 0 in 0.195s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-17994dc8-8bdf-448d-9f64-cb630a72474c tempest-VolumesExtendTest-1606581106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.034s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:11:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.885s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:11:37 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-178473845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c49feaa6-fa86-475b-b769-3029830bd294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c29e0335ce794aeda72d1faa959b9d40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:11:37Z,use_quota=True,user_id='abd62709f40049bf8a69c18c38d4fdd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:11:37 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] Creating volume c49feaa6-fa86-475b-b769-3029830bd294 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:11:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:11:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:11:37 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:11:37 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:11:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:11:37 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:11:37 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:11:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c49feaa6-fa86-475b-b769-3029830bd294 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:37 devstack sudo[92982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c49feaa6-fa86-475b-b769-3029830bd294 1073741824 Jul 10 18:11:37 devstack sudo[92982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:37 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-17994dc8-8bdf-448d-9f64-cb630a72474c tempest-VolumesExtendTest-1606581106 None] Extend volume completed successfully. Jul 10 18:11:38 devstack sudo[92982]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c49feaa6-fa86-475b-b769-3029830bd294 1073741824" returned: 0 in 0.921s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c49feaa6-fa86-475b-b769-3029830bd294 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:38 devstack sudo[92989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c49feaa6-fa86-475b-b769-3029830bd294 Jul 10 18:11:38 devstack sudo[92989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:39 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-dc28ff45-b5d6-4a83-a6bd-f21fdcd063bd tempest-VolumesExtendTest-1606581106 None] Acquiring lock "cinder-2ffc1712-4327-44cf-a84b-c72da4e329d5-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:11:39 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-dc28ff45-b5d6-4a83-a6bd-f21fdcd063bd tempest-VolumesExtendTest-1606581106 None] Lock "cinder-2ffc1712-4327-44cf-a84b-c72da4e329d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:11:39 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-dc28ff45-b5d6-4a83-a6bd-f21fdcd063bd tempest-VolumesExtendTest-1606581106 None] Acquiring lock "cinder-quobyte-49572ba1-2b3e-4821-a42f-6630ce39d0d2" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:11:39 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-dc28ff45-b5d6-4a83-a6bd-f21fdcd063bd tempest-VolumesExtendTest-1606581106 None] Lock "cinder-quobyte-49572ba1-2b3e-4821-a42f-6630ce39d0d2" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:11:39 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-dc28ff45-b5d6-4a83-a6bd-f21fdcd063bd tempest-VolumesExtendTest-1606581106 None] Acquiring lock "cinder-quobyte-2ffc1712-4327-44cf-a84b-c72da4e329d5" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:11:39 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-dc28ff45-b5d6-4a83-a6bd-f21fdcd063bd tempest-VolumesExtendTest-1606581106 None] Lock "cinder-quobyte-2ffc1712-4327-44cf-a84b-c72da4e329d5" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:11:39 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-dc28ff45-b5d6-4a83-a6bd-f21fdcd063bd tempest-VolumesExtendTest-1606581106 None] Deleting offline snapshot 2ffc1712-4327-44cf-a84b-c72da4e329d5 of volume 49572ba1-2b3e-4821-a42f-6630ce39d0d2 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:11:39 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-dc28ff45-b5d6-4a83-a6bd-f21fdcd063bd tempest-VolumesExtendTest-1606581106 None] snapshot_file for this snap is: volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2.2ffc1712-4327-44cf-a84b-c72da4e329d5 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:11:39 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c32506-43f7-4e1c-90db-3a24b54afc49]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:11:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-dc28ff45-b5d6-4a83-a6bd-f21fdcd063bd tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2.2ffc1712-4327-44cf-a84b-c72da4e329d5 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:39 devstack sudo[92998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2.2ffc1712-4327-44cf-a84b-c72da4e329d5 Jul 10 18:11:39 devstack sudo[92998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:39 devstack sudo[92989]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c49feaa6-fa86-475b-b769-3029830bd294" returned: 0 in 0.828s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:39 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:11:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:11:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a148a8d3-8bd1-4bb5-9346-2ba5bcf4066c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c49feaa6-fa86-475b-b769-3029830bd294', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (104bbae5-5edf-422d-95a1-6aca7c304be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:39 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] Volume volume-c49feaa6-fa86-475b-b769-3029830bd294 (c49feaa6-fa86-475b-b769-3029830bd294): created successfully Jul 10 18:11:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (104bbae5-5edf-422d-95a1-6aca7c304be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] Flow 'volume_create_manager' (a32ac376-5484-431f-828f-a1c249792e7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:11:39 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-c568df9e-d91f-4575-8dc3-61ce4061cb56 tempest-ServersNegativeTestJSON-1557285508 None] Created volume successfully. Jul 10 18:11:40 devstack sudo[92998]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-dc28ff45-b5d6-4a83-a6bd-f21fdcd063bd tempest-VolumesExtendTest-1606581106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2.2ffc1712-4327-44cf-a84b-c72da4e329d5" returned: 0 in 1.132s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:40 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-dc28ff45-b5d6-4a83-a6bd-f21fdcd063bd tempest-VolumesExtendTest-1606581106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:11:40 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f10932-0112-42f6-b31b-42fcc200df24]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:11:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-dc28ff45-b5d6-4a83-a6bd-f21fdcd063bd tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:40 devstack sudo[93053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2 Jul 10 18:11:40 devstack sudo[93053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:41 devstack sudo[93053]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-dc28ff45-b5d6-4a83-a6bd-f21fdcd063bd tempest-VolumesExtendTest-1606581106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2" returned: 0 in 0.926s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-dc28ff45-b5d6-4a83-a6bd-f21fdcd063bd tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2.2ffc1712-4327-44cf-a84b-c72da4e329d5 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:41 devstack sudo[93062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2.2ffc1712-4327-44cf-a84b-c72da4e329d5 Jul 10 18:11:41 devstack sudo[93062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:42 devstack sudo[93062]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-dc28ff45-b5d6-4a83-a6bd-f21fdcd063bd tempest-VolumesExtendTest-1606581106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2.2ffc1712-4327-44cf-a84b-c72da4e329d5" returned: 0 in 0.994s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-dc28ff45-b5d6-4a83-a6bd-f21fdcd063bd tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2.2ffc1712-4327-44cf-a84b-c72da4e329d5 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:42 devstack sudo[93069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2.2ffc1712-4327-44cf-a84b-c72da4e329d5 Jul 10 18:11:42 devstack sudo[93069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:42 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=71,cinder:UPDATE=80,cinder:DELETE=6,cinder:INSERT=16 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:11:42 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=51,cinder:UPDATE=64,cinder:INSERT=24,cinder:DELETE=6 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:11:42 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:11:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] Flow 'volume_create_manager' (781323e1-a4c3-4476-afaf-63b75e1e3af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:11:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3244db4-cba5-4ab2-9b7b-45f08375f252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3244db4-cba5-4ab2-9b7b-45f08375f252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1219640780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f180098-6fd3-47bc-afed-74d6cc9694c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c29e0335ce794aeda72d1faa959b9d40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:11:42Z,use_quota=True,user_id='abd62709f40049bf8a69c18c38d4fdd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bdc0832-93d0-40f6-be6e-55679a8ce6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bdc0832-93d0-40f6-be6e-55679a8ce6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8adcf634-6fec-4ed9-9be1-15fc9236b429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8adcf634-6fec-4ed9-9be1-15fc9236b429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f180098-6fd3-47bc-afed-74d6cc9694c9', 'volume_name': 'volume-3f180098-6fd3-47bc-afed-74d6cc9694c9', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19548fb8-454f-4a52-95f9-0d57d5314053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19548fb8-454f-4a52-95f9-0d57d5314053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e39b8ae-e58e-4d36-a57c-230645fb4584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:42 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] Volume 3f180098-6fd3-47bc-afed-74d6cc9694c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f180098-6fd3-47bc-afed-74d6cc9694c9', 'volume_size': 1} Jul 10 18:11:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:11:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:11:42 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1219640780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f180098-6fd3-47bc-afed-74d6cc9694c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c29e0335ce794aeda72d1faa959b9d40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:11:42Z,use_quota=True,user_id='abd62709f40049bf8a69c18c38d4fdd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:11:42 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] Creating volume 3f180098-6fd3-47bc-afed-74d6cc9694c9 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:11:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:11:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:11:42 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:11:42 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:11:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:11:42 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:11:42 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:11:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3f180098-6fd3-47bc-afed-74d6cc9694c9 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:42 devstack sudo[93071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3f180098-6fd3-47bc-afed-74d6cc9694c9 1073741824 Jul 10 18:11:42 devstack sudo[93071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:43 devstack sudo[93069]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-dc28ff45-b5d6-4a83-a6bd-f21fdcd063bd tempest-VolumesExtendTest-1606581106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2.2ffc1712-4327-44cf-a84b-c72da4e329d5" returned: 0 in 0.790s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:43 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-dc28ff45-b5d6-4a83-a6bd-f21fdcd063bd tempest-VolumesExtendTest-1606581106 None] Lock "cinder-quobyte-2ffc1712-4327-44cf-a84b-c72da4e329d5" released by "_delete_snapshot" :: held 4.007s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:11:43 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-dc28ff45-b5d6-4a83-a6bd-f21fdcd063bd tempest-VolumesExtendTest-1606581106 None] Lock "cinder-quobyte-49572ba1-2b3e-4821-a42f-6630ce39d0d2" released by "delete_snapshot" :: held 4.041s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:11:43 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-dc28ff45-b5d6-4a83-a6bd-f21fdcd063bd tempest-VolumesExtendTest-1606581106 None] Created reservations ['8ee0e1b6-49dc-49d0-aad0-70bb2ba0bdde', '2f189239-40ee-44ff-a8fe-43d635812fb6', 'a2b878c8-b36b-400e-ab3e-4e18ac8777ad', 'e6ed02c6-3fcd-45a4-87f9-e2875c280ebb'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:11:43 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-dc28ff45-b5d6-4a83-a6bd-f21fdcd063bd tempest-VolumesExtendTest-1606581106 None] Delete snapshot completed successfully. Jul 10 18:11:43 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-dc28ff45-b5d6-4a83-a6bd-f21fdcd063bd tempest-VolumesExtendTest-1606581106 None] Lock "cinder-2ffc1712-4327-44cf-a84b-c72da4e329d5-delete_snapshot" released by "delete_snapshot" :: held 4.257s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:11:43 devstack sudo[93071]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3f180098-6fd3-47bc-afed-74d6cc9694c9 1073741824" returned: 0 in 0.990s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3f180098-6fd3-47bc-afed-74d6cc9694c9 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:43 devstack sudo[93078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3f180098-6fd3-47bc-afed-74d6cc9694c9 Jul 10 18:11:43 devstack sudo[93078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:44 devstack sudo[93078]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3f180098-6fd3-47bc-afed-74d6cc9694c9" returned: 0 in 0.652s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:44 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] <== create_volume: return (1683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:11:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:11:44 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e39b8ae-e58e-4d36-a57c-230645fb4584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f180098-6fd3-47bc-afed-74d6cc9694c9', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:44 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0713aa48-25a0-4047-8697-06fa88ff6975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:44 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] Volume volume-3f180098-6fd3-47bc-afed-74d6cc9694c9 (3f180098-6fd3-47bc-afed-74d6cc9694c9): created successfully Jul 10 18:11:44 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0713aa48-25a0-4047-8697-06fa88ff6975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:44 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] Flow 'volume_create_manager' (781323e1-a4c3-4476-afaf-63b75e1e3af6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:11:44 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-8c79f0ac-19b8-4b57-93a3-5c302b94491c tempest-ServersNegativeTestJSON-1557285508 None] Created volume successfully. Jul 10 18:11:44 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-6165b635-397d-4f13-ae9f-ad1c1f9afa4a tempest-VolumesExtendTest-1606581106 None] Acquiring lock "cinder-49572ba1-2b3e-4821-a42f-6630ce39d0d2-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:11:44 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-6165b635-397d-4f13-ae9f-ad1c1f9afa4a tempest-VolumesExtendTest-1606581106 None] Lock "cinder-49572ba1-2b3e-4821-a42f-6630ce39d0d2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:11:44 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-6165b635-397d-4f13-ae9f-ad1c1f9afa4a tempest-VolumesExtendTest-1606581106 None] Acquiring lock "cinder-quobyte-49572ba1-2b3e-4821-a42f-6630ce39d0d2" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:11:44 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-6165b635-397d-4f13-ae9f-ad1c1f9afa4a tempest-VolumesExtendTest-1606581106 None] Lock "cinder-quobyte-49572ba1-2b3e-4821-a42f-6630ce39d0d2" acquired by "delete_volume" :: waited 0.016s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:11:44 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f115e3-55a1-441b-8653-578f9fb2b942]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:11:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6165b635-397d-4f13-ae9f-ad1c1f9afa4a tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:44 devstack sudo[93081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2 Jul 10 18:11:44 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:45 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a3504466-30da-40c7-9a4d-f5428a31fed2 tempest-ServersNegativeTestJSON-1557285508 None] Acquiring lock "cinder-3f180098-6fd3-47bc-afed-74d6cc9694c9-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:11:45 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a3504466-30da-40c7-9a4d-f5428a31fed2 tempest-ServersNegativeTestJSON-1557285508 None] Lock "cinder-3f180098-6fd3-47bc-afed-74d6cc9694c9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:11:45 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a3504466-30da-40c7-9a4d-f5428a31fed2 tempest-ServersNegativeTestJSON-1557285508 None] Acquiring lock "cinder-quobyte-3f180098-6fd3-47bc-afed-74d6cc9694c9" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:11:45 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a3504466-30da-40c7-9a4d-f5428a31fed2 tempest-ServersNegativeTestJSON-1557285508 None] Lock "cinder-quobyte-3f180098-6fd3-47bc-afed-74d6cc9694c9" acquired by "delete_volume" :: waited 0.025s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:11:45 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bb0008-d95a-496d-ae8e-0cf0d0ac2b5b]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:11:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a3504466-30da-40c7-9a4d-f5428a31fed2 tempest-ServersNegativeTestJSON-1557285508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3f180098-6fd3-47bc-afed-74d6cc9694c9 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:45 devstack sudo[93084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3f180098-6fd3-47bc-afed-74d6cc9694c9 Jul 10 18:11:45 devstack sudo[93084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:45 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6165b635-397d-4f13-ae9f-ad1c1f9afa4a tempest-VolumesExtendTest-1606581106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2" returned: 0 in 1.190s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6165b635-397d-4f13-ae9f-ad1c1f9afa4a tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:45 devstack sudo[93089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2 Jul 10 18:11:45 devstack sudo[93089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:46 devstack sudo[93084]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a3504466-30da-40c7-9a4d-f5428a31fed2 tempest-ServersNegativeTestJSON-1557285508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3f180098-6fd3-47bc-afed-74d6cc9694c9" returned: 0 in 1.169s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a3504466-30da-40c7-9a4d-f5428a31fed2 tempest-ServersNegativeTestJSON-1557285508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3f180098-6fd3-47bc-afed-74d6cc9694c9 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:46 devstack sudo[93094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3f180098-6fd3-47bc-afed-74d6cc9694c9 Jul 10 18:11:46 devstack sudo[93094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:46 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-322547ce-8e45-4c34-85e7-c54b5d740b54 tempest-AttachVolumeShelveTestJSON-1165439608 None] Acquiring lock "cinder-5a5e2b49-c00f-4d02-9eb5-6051f33656f5-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:11:46 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-322547ce-8e45-4c34-85e7-c54b5d740b54 tempest-AttachVolumeShelveTestJSON-1165439608 None] Lock "cinder-5a5e2b49-c00f-4d02-9eb5-6051f33656f5-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:11:46 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-322547ce-8e45-4c34-85e7-c54b5d740b54 tempest-AttachVolumeShelveTestJSON-1165439608 None] Acquiring lock "cinder-quobyte-5a5e2b49-c00f-4d02-9eb5-6051f33656f5" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:11:46 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-322547ce-8e45-4c34-85e7-c54b5d740b54 tempest-AttachVolumeShelveTestJSON-1165439608 None] Lock "cinder-quobyte-5a5e2b49-c00f-4d02-9eb5-6051f33656f5" acquired by "delete_volume" :: waited 0.020s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:11:46 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c1a782-9bd4-43eb-b8ab-711b58f2029d]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:11:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-322547ce-8e45-4c34-85e7-c54b5d740b54 tempest-AttachVolumeShelveTestJSON-1165439608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5a5e2b49-c00f-4d02-9eb5-6051f33656f5 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:46 devstack sudo[93089]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6165b635-397d-4f13-ae9f-ad1c1f9afa4a tempest-VolumesExtendTest-1606581106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-49572ba1-2b3e-4821-a42f-6630ce39d0d2" returned: 0 in 0.889s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:46 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-6165b635-397d-4f13-ae9f-ad1c1f9afa4a tempest-VolumesExtendTest-1606581106 None] Lock "cinder-quobyte-49572ba1-2b3e-4821-a42f-6630ce39d0d2" released by "delete_volume" :: held 2.157s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:11:46 devstack sudo[93097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5a5e2b49-c00f-4d02-9eb5-6051f33656f5 Jul 10 18:11:46 devstack sudo[93097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:46 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-6165b635-397d-4f13-ae9f-ad1c1f9afa4a tempest-VolumesExtendTest-1606581106 None] Created reservations ['63dd917f-3eaf-4b43-a638-22789373b50d', 'e80f8951-1399-4494-af62-6e9bd50671be', '5a8a5a28-afe9-4ee2-8dfe-946813a96281', '0f249b2b-c435-42ae-a575-3a8858f76e04'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:11:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6165b635-397d-4f13-ae9f-ad1c1f9afa4a tempest-VolumesExtendTest-1606581106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:11:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6165b635-397d-4f13-ae9f-ad1c1f9afa4a tempest-VolumesExtendTest-1606581106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:11:46 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6165b635-397d-4f13-ae9f-ad1c1f9afa4a tempest-VolumesExtendTest-1606581106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:11:46 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6165b635-397d-4f13-ae9f-ad1c1f9afa4a tempest-VolumesExtendTest-1606581106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:11:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6165b635-397d-4f13-ae9f-ad1c1f9afa4a tempest-VolumesExtendTest-1606581106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:11:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6165b635-397d-4f13-ae9f-ad1c1f9afa4a tempest-VolumesExtendTest-1606581106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:46 devstack sudo[93099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:11:46 devstack sudo[93099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:47 devstack sudo[93094]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a3504466-30da-40c7-9a4d-f5428a31fed2 tempest-ServersNegativeTestJSON-1557285508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3f180098-6fd3-47bc-afed-74d6cc9694c9" returned: 0 in 0.755s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:47 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a3504466-30da-40c7-9a4d-f5428a31fed2 tempest-ServersNegativeTestJSON-1557285508 None] Lock "cinder-quobyte-3f180098-6fd3-47bc-afed-74d6cc9694c9" released by "delete_volume" :: held 1.993s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:11:47 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-a3504466-30da-40c7-9a4d-f5428a31fed2 tempest-ServersNegativeTestJSON-1557285508 None] Created reservations ['546e93db-75dd-485e-b5ab-f1cbcaebc202', '3162b445-c42e-4d65-8028-f4f08327e4c7', '6dad230e-1f10-4e69-92f0-ba682c61611e', '7538540a-e915-461b-90a8-9246e6a4f00d'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:11:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a3504466-30da-40c7-9a4d-f5428a31fed2 tempest-ServersNegativeTestJSON-1557285508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:11:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a3504466-30da-40c7-9a4d-f5428a31fed2 tempest-ServersNegativeTestJSON-1557285508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:11:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a3504466-30da-40c7-9a4d-f5428a31fed2 tempest-ServersNegativeTestJSON-1557285508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:11:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a3504466-30da-40c7-9a4d-f5428a31fed2 tempest-ServersNegativeTestJSON-1557285508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:11:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a3504466-30da-40c7-9a4d-f5428a31fed2 tempest-ServersNegativeTestJSON-1557285508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:11:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a3504466-30da-40c7-9a4d-f5428a31fed2 tempest-ServersNegativeTestJSON-1557285508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:47 devstack sudo[93102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:11:47 devstack sudo[93102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:47 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5cef3053-5fc4-4fe9-a843-24082d7f6936 tempest-ServersNegativeTestJSON-1557285508 None] Acquiring lock "cinder-c49feaa6-fa86-475b-b769-3029830bd294-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:11:47 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5cef3053-5fc4-4fe9-a843-24082d7f6936 tempest-ServersNegativeTestJSON-1557285508 None] Lock "cinder-c49feaa6-fa86-475b-b769-3029830bd294-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:11:47 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5cef3053-5fc4-4fe9-a843-24082d7f6936 tempest-ServersNegativeTestJSON-1557285508 None] Acquiring lock "cinder-quobyte-c49feaa6-fa86-475b-b769-3029830bd294" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:11:47 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5cef3053-5fc4-4fe9-a843-24082d7f6936 tempest-ServersNegativeTestJSON-1557285508 None] Lock "cinder-quobyte-c49feaa6-fa86-475b-b769-3029830bd294" acquired by "delete_volume" :: waited 0.017s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:11:47 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbb888d-7964-42a5-8041-3ba1788d6631]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:11:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5cef3053-5fc4-4fe9-a843-24082d7f6936 tempest-ServersNegativeTestJSON-1557285508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c49feaa6-fa86-475b-b769-3029830bd294 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:47 devstack sudo[93107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c49feaa6-fa86-475b-b769-3029830bd294 Jul 10 18:11:47 devstack sudo[93107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:47 devstack sudo[93097]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-322547ce-8e45-4c34-85e7-c54b5d740b54 tempest-AttachVolumeShelveTestJSON-1165439608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5a5e2b49-c00f-4d02-9eb5-6051f33656f5" returned: 0 in 1.130s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-322547ce-8e45-4c34-85e7-c54b5d740b54 tempest-AttachVolumeShelveTestJSON-1165439608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5a5e2b49-c00f-4d02-9eb5-6051f33656f5 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:47 devstack sudo[93110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5a5e2b49-c00f-4d02-9eb5-6051f33656f5 Jul 10 18:11:47 devstack sudo[93110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:47 devstack sudo[93099]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6165b635-397d-4f13-ae9f-ad1c1f9afa4a tempest-VolumesExtendTest-1606581106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.962s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:47 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-6165b635-397d-4f13-ae9f-ad1c1f9afa4a tempest-VolumesExtendTest-1606581106 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:11:47 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-6165b635-397d-4f13-ae9f-ad1c1f9afa4a tempest-VolumesExtendTest-1606581106 None] Deleted volume successfully. Jul 10 18:11:47 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-6165b635-397d-4f13-ae9f-ad1c1f9afa4a tempest-VolumesExtendTest-1606581106 None] Lock "cinder-49572ba1-2b3e-4821-a42f-6630ce39d0d2-delete_volume" released by "delete_volume" :: held 3.440s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:11:48 devstack sudo[93102]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a3504466-30da-40c7-9a4d-f5428a31fed2 tempest-ServersNegativeTestJSON-1557285508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.100s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:48 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-a3504466-30da-40c7-9a4d-f5428a31fed2 tempest-ServersNegativeTestJSON-1557285508 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:11:48 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-a3504466-30da-40c7-9a4d-f5428a31fed2 tempest-ServersNegativeTestJSON-1557285508 None] Deleted volume successfully. Jul 10 18:11:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a3504466-30da-40c7-9a4d-f5428a31fed2 tempest-ServersNegativeTestJSON-1557285508 None] Lock "cinder-3f180098-6fd3-47bc-afed-74d6cc9694c9-delete_volume" released by "delete_volume" :: held 3.400s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:11:48 devstack sudo[93110]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-322547ce-8e45-4c34-85e7-c54b5d740b54 tempest-AttachVolumeShelveTestJSON-1165439608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5a5e2b49-c00f-4d02-9eb5-6051f33656f5" returned: 0 in 0.913s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-322547ce-8e45-4c34-85e7-c54b5d740b54 tempest-AttachVolumeShelveTestJSON-1165439608 None] Lock "cinder-quobyte-5a5e2b49-c00f-4d02-9eb5-6051f33656f5" released by "delete_volume" :: held 2.113s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:11:48 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-322547ce-8e45-4c34-85e7-c54b5d740b54 tempest-AttachVolumeShelveTestJSON-1165439608 None] Created reservations ['188b726c-e52a-43fd-9d2b-7cb6660ec74c', '196e1b20-c52b-4368-8cbc-d374966888f5', '3a893626-21eb-4b15-80fa-7af866bad32a', '2e719ad5-b4d2-4120-9c0a-45c5e636c0ca'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:11:48 devstack sudo[93107]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5cef3053-5fc4-4fe9-a843-24082d7f6936 tempest-ServersNegativeTestJSON-1557285508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c49feaa6-fa86-475b-b769-3029830bd294" returned: 0 in 1.292s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5cef3053-5fc4-4fe9-a843-24082d7f6936 tempest-ServersNegativeTestJSON-1557285508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c49feaa6-fa86-475b-b769-3029830bd294 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-322547ce-8e45-4c34-85e7-c54b5d740b54 tempest-AttachVolumeShelveTestJSON-1165439608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:11:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-322547ce-8e45-4c34-85e7-c54b5d740b54 tempest-AttachVolumeShelveTestJSON-1165439608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:11:48 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-322547ce-8e45-4c34-85e7-c54b5d740b54 tempest-AttachVolumeShelveTestJSON-1165439608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:11:48 devstack sudo[93117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c49feaa6-fa86-475b-b769-3029830bd294 Jul 10 18:11:48 devstack sudo[93117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:48 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-322547ce-8e45-4c34-85e7-c54b5d740b54 tempest-AttachVolumeShelveTestJSON-1165439608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:11:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-322547ce-8e45-4c34-85e7-c54b5d740b54 tempest-AttachVolumeShelveTestJSON-1165439608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:11:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-322547ce-8e45-4c34-85e7-c54b5d740b54 tempest-AttachVolumeShelveTestJSON-1165439608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:48 devstack sudo[93119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:11:48 devstack sudo[93119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:49 devstack sudo[93117]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5cef3053-5fc4-4fe9-a843-24082d7f6936 tempest-ServersNegativeTestJSON-1557285508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c49feaa6-fa86-475b-b769-3029830bd294" returned: 0 in 0.848s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:49 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5cef3053-5fc4-4fe9-a843-24082d7f6936 tempest-ServersNegativeTestJSON-1557285508 None] Lock "cinder-quobyte-c49feaa6-fa86-475b-b769-3029830bd294" released by "delete_volume" :: held 2.206s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:11:49 devstack sudo[93119]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-322547ce-8e45-4c34-85e7-c54b5d740b54 tempest-AttachVolumeShelveTestJSON-1165439608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.833s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:49 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-322547ce-8e45-4c34-85e7-c54b5d740b54 tempest-AttachVolumeShelveTestJSON-1165439608 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:11:49 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-322547ce-8e45-4c34-85e7-c54b5d740b54 tempest-AttachVolumeShelveTestJSON-1165439608 None] Deleted volume successfully. Jul 10 18:11:49 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-322547ce-8e45-4c34-85e7-c54b5d740b54 tempest-AttachVolumeShelveTestJSON-1165439608 None] Lock "cinder-5a5e2b49-c00f-4d02-9eb5-6051f33656f5-delete_volume" released by "delete_volume" :: held 3.355s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:11:49 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-5cef3053-5fc4-4fe9-a843-24082d7f6936 tempest-ServersNegativeTestJSON-1557285508 None] Created reservations ['ccbcd55c-8c19-46a5-b808-a48ab79153c8', 'f53710a7-3f50-43cc-a815-99d8850a2448', '99bbc390-080e-4363-ac7a-10255ab4a36c', '27505c05-4273-4a95-9a5f-36e11cc98015'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:11:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5cef3053-5fc4-4fe9-a843-24082d7f6936 tempest-ServersNegativeTestJSON-1557285508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:11:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5cef3053-5fc4-4fe9-a843-24082d7f6936 tempest-ServersNegativeTestJSON-1557285508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:11:49 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5cef3053-5fc4-4fe9-a843-24082d7f6936 tempest-ServersNegativeTestJSON-1557285508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:11:50 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5cef3053-5fc4-4fe9-a843-24082d7f6936 tempest-ServersNegativeTestJSON-1557285508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:11:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5cef3053-5fc4-4fe9-a843-24082d7f6936 tempest-ServersNegativeTestJSON-1557285508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:11:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5cef3053-5fc4-4fe9-a843-24082d7f6936 tempest-ServersNegativeTestJSON-1557285508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:50 devstack sudo[93123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:11:50 devstack sudo[93123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:50 devstack sudo[93123]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5cef3053-5fc4-4fe9-a843-24082d7f6936 tempest-ServersNegativeTestJSON-1557285508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.839s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:50 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-5cef3053-5fc4-4fe9-a843-24082d7f6936 tempest-ServersNegativeTestJSON-1557285508 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:11:50 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-5cef3053-5fc4-4fe9-a843-24082d7f6936 tempest-ServersNegativeTestJSON-1557285508 None] Deleted volume successfully. Jul 10 18:11:50 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5cef3053-5fc4-4fe9-a843-24082d7f6936 tempest-ServersNegativeTestJSON-1557285508 None] Lock "cinder-c49feaa6-fa86-475b-b769-3029830bd294-delete_volume" released by "delete_volume" :: held 3.404s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:11:57 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:11:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:11:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:11:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:11:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:11:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:11:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:57 devstack sudo[93158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:11:57 devstack sudo[93158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:11:58 devstack sudo[93158]: pam_unix(sudo:session): session closed for user root Jul 10 18:11:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.887s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:11:58 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:11:58 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager._thread_info {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:11:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread count: 28 {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 18:11:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread info: [<_MainThread(MainThread, started 139757428633728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 18:11:59 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:11:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] Flow 'volume_create_manager' (ee57b158-3242-4448-8005-b93a47d22270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:11:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c946d337-1e51-4606-a477-09079781f582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c946d337-1e51-4606-a477-09079781f582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1948747767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d743ebcc-1c27-4359-a7ed-6f6266b35a62,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8ef10ba6b1e04cf499bc73b35b84e885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:11:59Z,use_quota=True,user_id='d50a0895f3354aa5919f232c2cfc1a05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eede01d3-6d47-498e-b535-86c28a24481a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eede01d3-6d47-498e-b535-86c28a24481a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b4707a7-2c61-409c-8926-90c72253df7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b4707a7-2c61-409c-8926-90c72253df7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd743ebcc-1c27-4359-a7ed-6f6266b35a62', 'volume_name': 'volume-d743ebcc-1c27-4359-a7ed-6f6266b35a62', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bac00fe-40b4-4d96-ac78-53fd3fd64c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bac00fe-40b4-4d96-ac78-53fd3fd64c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:11:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf04487-edb5-4931-bffb-cda1a41623a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:11:59 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] Volume d743ebcc-1c27-4359-a7ed-6f6266b35a62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d743ebcc-1c27-4359-a7ed-6f6266b35a62', 'volume_size': 1} Jul 10 18:11:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:11:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:11:59 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1948747767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d743ebcc-1c27-4359-a7ed-6f6266b35a62,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8ef10ba6b1e04cf499bc73b35b84e885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:11:59Z,use_quota=True,user_id='d50a0895f3354aa5919f232c2cfc1a05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:11:59 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] Creating volume d743ebcc-1c27-4359-a7ed-6f6266b35a62 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:11:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:11:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:11:59 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:11:59 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:11:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:11:59 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:11:59 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:11:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d743ebcc-1c27-4359-a7ed-6f6266b35a62 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:11:59 devstack sudo[93167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d743ebcc-1c27-4359-a7ed-6f6266b35a62 1073741824 Jul 10 18:11:59 devstack sudo[93167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:00 devstack sudo[93167]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d743ebcc-1c27-4359-a7ed-6f6266b35a62 1073741824" returned: 0 in 1.002s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d743ebcc-1c27-4359-a7ed-6f6266b35a62 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:00 devstack sudo[93173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d743ebcc-1c27-4359-a7ed-6f6266b35a62 Jul 10 18:12:00 devstack sudo[93173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:01 devstack sudo[93173]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d743ebcc-1c27-4359-a7ed-6f6266b35a62" returned: 0 in 0.745s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:01 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] <== create_volume: return (1789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:12:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.791s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:12:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf04487-edb5-4931-bffb-cda1a41623a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d743ebcc-1c27-4359-a7ed-6f6266b35a62', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c41e48de-de5c-4d13-b0d5-ba28130c7ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:01 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] Volume volume-d743ebcc-1c27-4359-a7ed-6f6266b35a62 (d743ebcc-1c27-4359-a7ed-6f6266b35a62): created successfully Jul 10 18:12:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c41e48de-de5c-4d13-b0d5-ba28130c7ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] Flow 'volume_create_manager' (ee57b158-3242-4448-8005-b93a47d22270) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:12:01 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-204fc54f-16cc-4b46-8aa8-3895fc722748 tempest-VolumesTestJSON-1385041480 None] Created volume successfully. Jul 10 18:12:03 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:12:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] Flow 'volume_create_manager' (118c0b03-ab74-41d6-9de9-a6c55e581ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:12:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7206a8f4-f795-4803-8f8a-485e508b2769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7206a8f4-f795-4803-8f8a-485e508b2769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-233523790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=403e1e49-aaab-4ca8-9ba2-ff2a5bb4b68a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8ef10ba6b1e04cf499bc73b35b84e885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:12:03Z,use_quota=True,user_id='d50a0895f3354aa5919f232c2cfc1a05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b0015d-61b6-44ac-9895-4043bac85862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b0015d-61b6-44ac-9895-4043bac85862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a225ca-0798-4e20-a485-322d5e806c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a225ca-0798-4e20-a485-322d5e806c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '403e1e49-aaab-4ca8-9ba2-ff2a5bb4b68a', 'volume_name': 'volume-403e1e49-aaab-4ca8-9ba2-ff2a5bb4b68a', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a95c0829-8ae3-405e-9562-1fa9195c35f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a95c0829-8ae3-405e-9562-1fa9195c35f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c209e810-0aff-4a06-a43e-a2de610b5c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:03 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] Volume 403e1e49-aaab-4ca8-9ba2-ff2a5bb4b68a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-403e1e49-aaab-4ca8-9ba2-ff2a5bb4b68a', 'volume_size': 1} Jul 10 18:12:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:12:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:12:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:12:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-233523790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=403e1e49-aaab-4ca8-9ba2-ff2a5bb4b68a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8ef10ba6b1e04cf499bc73b35b84e885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:12:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:12:03Z,use_quota=True,user_id='d50a0895f3354aa5919f232c2cfc1a05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:12:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] Creating volume 403e1e49-aaab-4ca8-9ba2-ff2a5bb4b68a {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:12:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:12:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:12:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:12:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:12:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:12:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:12:03 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:12:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-403e1e49-aaab-4ca8-9ba2-ff2a5bb4b68a 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:03 devstack sudo[93177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-403e1e49-aaab-4ca8-9ba2-ff2a5bb4b68a 1073741824 Jul 10 18:12:03 devstack sudo[93177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:04 devstack sudo[93177]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-403e1e49-aaab-4ca8-9ba2-ff2a5bb4b68a 1073741824" returned: 0 in 0.984s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-403e1e49-aaab-4ca8-9ba2-ff2a5bb4b68a {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:04 devstack sudo[93183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-403e1e49-aaab-4ca8-9ba2-ff2a5bb4b68a Jul 10 18:12:04 devstack sudo[93183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:05 devstack sudo[93183]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-403e1e49-aaab-4ca8-9ba2-ff2a5bb4b68a" returned: 0 in 0.873s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:05 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] <== create_volume: return (1900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:12:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.903s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:12:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c209e810-0aff-4a06-a43e-a2de610b5c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-403e1e49-aaab-4ca8-9ba2-ff2a5bb4b68a', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1dca227-b3e0-4688-828a-ef429254300c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:05 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] Volume volume-403e1e49-aaab-4ca8-9ba2-ff2a5bb4b68a (403e1e49-aaab-4ca8-9ba2-ff2a5bb4b68a): created successfully Jul 10 18:12:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1dca227-b3e0-4688-828a-ef429254300c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] Flow 'volume_create_manager' (118c0b03-ab74-41d6-9de9-a6c55e581ad1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:12:05 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-9ca5c8e7-c675-408a-8be6-a1199f773df6 tempest-VolumesTestJSON-1385041480 None] Created volume successfully. Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] Flow 'volume_create_manager' (2a5f2869-074a-4d4a-96b7-081a9a246e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d21e89-1353-4f40-bc2a-0b7a17f285a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d21e89-1353-4f40-bc2a-0b7a17f285a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1410516366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3512d33aea1f4adcbdcebee20b26e02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:12:07Z,use_quota=True,user_id='e55c9bd52bc14d8f9743a588bcf2c85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce9286a7-57ae-4e7a-8be5-f04f65fa8a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce9286a7-57ae-4e7a-8be5-f04f65fa8a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b014da9c-9d00-4306-9092-765608317868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b014da9c-9d00-4306-9092-765608317868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0', 'volume_name': 'volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce654d4c-2a1c-4328-8e37-04fd9a98ce8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce654d4c-2a1c-4328-8e37-04fd9a98ce8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90244e5d-f207-4415-a639-6d61916fd52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:07 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] Volume 9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0', 'volume_size': 1} Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1410516366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3512d33aea1f4adcbdcebee20b26e02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:12:07Z,use_quota=True,user_id='e55c9bd52bc14d8f9743a588bcf2c85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] Creating volume 9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:12:07 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:07 devstack sudo[93188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0 1073741824 Jul 10 18:12:07 devstack sudo[93188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] Flow 'volume_create_manager' (fc74b647-6cdf-46f8-90f6-5fa7f7bec5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e09dd8b9-0a1f-420e-bc26-ce1296b93e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e09dd8b9-0a1f-420e-bc26-ce1296b93e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1952229929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75301a3-096e-48f2-a0fd-ec078fcd0afe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8ef10ba6b1e04cf499bc73b35b84e885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:12:07Z,use_quota=True,user_id='d50a0895f3354aa5919f232c2cfc1a05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce0a3285-20eb-4d97-bca8-2f769b2ac2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce0a3285-20eb-4d97-bca8-2f769b2ac2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (707123ef-e370-47c0-8b91-753cdb955fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (707123ef-e370-47c0-8b91-753cdb955fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b75301a3-096e-48f2-a0fd-ec078fcd0afe', 'volume_name': 'volume-b75301a3-096e-48f2-a0fd-ec078fcd0afe', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48dd049-7199-4d60-b2ac-02830eff5eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48dd049-7199-4d60-b2ac-02830eff5eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (babda9cd-365e-4766-a018-0ca3f5f2e88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:07 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] Volume b75301a3-096e-48f2-a0fd-ec078fcd0afe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b75301a3-096e-48f2-a0fd-ec078fcd0afe', 'volume_size': 1} Jul 10 18:12:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:12:08 devstack sudo[93188]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0 1073741824" returned: 0 in 1.033s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:08 devstack sudo[93194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0 Jul 10 18:12:08 devstack sudo[93194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:09 devstack sudo[93194]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0" returned: 0 in 0.774s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] <== create_volume: return (1857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:12:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.862s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:12:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.674s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:12:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1952229929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75301a3-096e-48f2-a0fd-ec078fcd0afe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8ef10ba6b1e04cf499bc73b35b84e885',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:12:07Z,use_quota=True,user_id='d50a0895f3354aa5919f232c2cfc1a05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:12:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] Creating volume b75301a3-096e-48f2-a0fd-ec078fcd0afe {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:12:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:12:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:12:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:12:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:12:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:12:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:12:09 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:12:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b75301a3-096e-48f2-a0fd-ec078fcd0afe 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:09 devstack sudo[93197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b75301a3-096e-48f2-a0fd-ec078fcd0afe 1073741824 Jul 10 18:12:09 devstack sudo[93197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:09 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90244e5d-f207-4415-a639-6d61916fd52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:09 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c89d4263-a914-42c9-b571-95262a4598f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:09 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] Volume volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0 (9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0): created successfully Jul 10 18:12:09 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c89d4263-a914-42c9-b571-95262a4598f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:09 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] Flow 'volume_create_manager' (2a5f2869-074a-4d4a-96b7-081a9a246e48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:12:09 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-4444ac88-3ae6-4d69-a49f-8590357344fc tempest-VolumesSnapshotTestJSON-907745065 None] Created volume successfully. Jul 10 18:12:10 devstack sudo[93197]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b75301a3-096e-48f2-a0fd-ec078fcd0afe 1073741824" returned: 0 in 1.061s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b75301a3-096e-48f2-a0fd-ec078fcd0afe {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:10 devstack sudo[93203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b75301a3-096e-48f2-a0fd-ec078fcd0afe Jul 10 18:12:10 devstack sudo[93203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d04b4f99-8d8d-4f27-9bcc-53a546e98190 tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:12:11 devstack sudo[93203]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b75301a3-096e-48f2-a0fd-ec078fcd0afe" returned: 0 in 0.851s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:11 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] <== create_volume: return (1972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:12:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:12:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d04b4f99-8d8d-4f27-9bcc-53a546e98190 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.594s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:12:11 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-d04b4f99-8d8d-4f27-9bcc-53a546e98190 tempest-VolumesSnapshotTestJSON-907745065 None] Creating offline snapshot 43bd64a0-01a4-4aa5-a556-bad76f6c175c of volume 9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0 {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:12:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (babda9cd-365e-4766-a018-0ca3f5f2e88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b75301a3-096e-48f2-a0fd-ec078fcd0afe', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (805a4814-afb7-4ce6-9fb1-01e1186de508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:11 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[376a5942-3c75-4c42-bbba-253f67430ea2]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:12:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d04b4f99-8d8d-4f27-9bcc-53a546e98190 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:11 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] Volume volume-b75301a3-096e-48f2-a0fd-ec078fcd0afe (b75301a3-096e-48f2-a0fd-ec078fcd0afe): created successfully Jul 10 18:12:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (805a4814-afb7-4ce6-9fb1-01e1186de508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] Flow 'volume_create_manager' (fc74b647-6cdf-46f8-90f6-5fa7f7bec5be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:12:11 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-38031f7f-779e-4244-ac20-0a0c3d045b5d tempest-VolumesTestJSON-1385041480 None] Created volume successfully. Jul 10 18:12:11 devstack sudo[93206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0 Jul 10 18:12:11 devstack sudo[93206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:12 devstack sudo[93206]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d04b4f99-8d8d-4f27-9bcc-53a546e98190 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0" returned: 0 in 1.043s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d04b4f99-8d8d-4f27-9bcc-53a546e98190 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0.43bd64a0-01a4-4aa5-a556-bad76f6c175c 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:12 devstack sudo[93211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0.43bd64a0-01a4-4aa5-a556-bad76f6c175c 1G Jul 10 18:12:12 devstack sudo[93211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d27a71ee-cc03-4043-a335-c2ea0b984efc tempest-VolumesTestJSON-1385041480 None] Acquiring lock "cinder-b75301a3-096e-48f2-a0fd-ec078fcd0afe-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:12:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d27a71ee-cc03-4043-a335-c2ea0b984efc tempest-VolumesTestJSON-1385041480 None] Lock "cinder-b75301a3-096e-48f2-a0fd-ec078fcd0afe-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:12:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d27a71ee-cc03-4043-a335-c2ea0b984efc tempest-VolumesTestJSON-1385041480 None] Acquiring lock "cinder-quobyte-b75301a3-096e-48f2-a0fd-ec078fcd0afe" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:12:13 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d27a71ee-cc03-4043-a335-c2ea0b984efc tempest-VolumesTestJSON-1385041480 None] Lock "cinder-quobyte-b75301a3-096e-48f2-a0fd-ec078fcd0afe" acquired by "delete_volume" :: waited 0.021s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:12:13 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[91404e9f-1f04-4f91-8e54-6c98c8dd3f9e]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:12:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d27a71ee-cc03-4043-a335-c2ea0b984efc tempest-VolumesTestJSON-1385041480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b75301a3-096e-48f2-a0fd-ec078fcd0afe {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:13 devstack sudo[93216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b75301a3-096e-48f2-a0fd-ec078fcd0afe Jul 10 18:12:13 devstack sudo[93216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:13 devstack sudo[93211]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d04b4f99-8d8d-4f27-9bcc-53a546e98190 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0.43bd64a0-01a4-4aa5-a556-bad76f6c175c 1G" returned: 0 in 1.085s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d04b4f99-8d8d-4f27-9bcc-53a546e98190 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0.43bd64a0-01a4-4aa5-a556-bad76f6c175c {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:13 devstack sudo[93222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0.43bd64a0-01a4-4aa5-a556-bad76f6c175c Jul 10 18:12:13 devstack sudo[93222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:14 devstack sudo[93216]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d27a71ee-cc03-4043-a335-c2ea0b984efc tempest-VolumesTestJSON-1385041480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b75301a3-096e-48f2-a0fd-ec078fcd0afe" returned: 0 in 1.028s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d27a71ee-cc03-4043-a335-c2ea0b984efc tempest-VolumesTestJSON-1385041480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b75301a3-096e-48f2-a0fd-ec078fcd0afe {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:14 devstack sudo[93231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b75301a3-096e-48f2-a0fd-ec078fcd0afe Jul 10 18:12:14 devstack sudo[93231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:14 devstack sudo[93222]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d04b4f99-8d8d-4f27-9bcc-53a546e98190 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0.43bd64a0-01a4-4aa5-a556-bad76f6c175c" returned: 0 in 0.913s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:14 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-d04b4f99-8d8d-4f27-9bcc-53a546e98190 tempest-VolumesSnapshotTestJSON-907745065 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0.43bd64a0-01a4-4aa5-a556-bad76f6c175c is being set with open permissions: ugo+rw Jul 10 18:12:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d04b4f99-8d8d-4f27-9bcc-53a546e98190 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0.43bd64a0-01a4-4aa5-a556-bad76f6c175c {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:14 devstack sudo[93233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0.43bd64a0-01a4-4aa5-a556-bad76f6c175c Jul 10 18:12:14 devstack sudo[93233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:14 devstack sudo[93231]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d27a71ee-cc03-4043-a335-c2ea0b984efc tempest-VolumesTestJSON-1385041480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b75301a3-096e-48f2-a0fd-ec078fcd0afe" returned: 0 in 0.847s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:14 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d27a71ee-cc03-4043-a335-c2ea0b984efc tempest-VolumesTestJSON-1385041480 None] Lock "cinder-quobyte-b75301a3-096e-48f2-a0fd-ec078fcd0afe" released by "delete_volume" :: held 1.938s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:12:15 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-d27a71ee-cc03-4043-a335-c2ea0b984efc tempest-VolumesTestJSON-1385041480 None] Created reservations ['762eceb3-a70e-4800-b9a0-5ef48e628750', '4ab8b349-aa00-461d-b21c-3ea5e0f7819c', 'c21a8757-6102-4be1-9ff1-2b370a1c9819', 'cbb82405-060d-4cd7-86f8-47ed9e649859'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:12:15 devstack sudo[93233]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d04b4f99-8d8d-4f27-9bcc-53a546e98190 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0.43bd64a0-01a4-4aa5-a556-bad76f6c175c" returned: 0 in 0.861s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d27a71ee-cc03-4043-a335-c2ea0b984efc tempest-VolumesTestJSON-1385041480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:12:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d27a71ee-cc03-4043-a335-c2ea0b984efc tempest-VolumesTestJSON-1385041480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:12:15 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d27a71ee-cc03-4043-a335-c2ea0b984efc tempest-VolumesTestJSON-1385041480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:12:15 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d27a71ee-cc03-4043-a335-c2ea0b984efc tempest-VolumesTestJSON-1385041480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:12:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d27a71ee-cc03-4043-a335-c2ea0b984efc tempest-VolumesTestJSON-1385041480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:12:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d27a71ee-cc03-4043-a335-c2ea0b984efc tempest-VolumesTestJSON-1385041480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d04b4f99-8d8d-4f27-9bcc-53a546e98190 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:15 devstack sudo[93237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:12:15 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:15 devstack sudo[93239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0.info Jul 10 18:12:15 devstack sudo[93239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:15 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0adb204a-29c7-4380-895f-328e24f9746d tempest-VolumesTestJSON-1385041480 None] Acquiring lock "cinder-403e1e49-aaab-4ca8-9ba2-ff2a5bb4b68a-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:12:15 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0adb204a-29c7-4380-895f-328e24f9746d tempest-VolumesTestJSON-1385041480 None] Lock "cinder-403e1e49-aaab-4ca8-9ba2-ff2a5bb4b68a-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:12:15 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0adb204a-29c7-4380-895f-328e24f9746d tempest-VolumesTestJSON-1385041480 None] Acquiring lock "cinder-quobyte-403e1e49-aaab-4ca8-9ba2-ff2a5bb4b68a" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:12:15 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0adb204a-29c7-4380-895f-328e24f9746d tempest-VolumesTestJSON-1385041480 None] Lock "cinder-quobyte-403e1e49-aaab-4ca8-9ba2-ff2a5bb4b68a" acquired by "delete_volume" :: waited 0.026s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:12:15 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[f240d07c-38f2-4401-b00c-e9eff9d036fb]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:12:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0adb204a-29c7-4380-895f-328e24f9746d tempest-VolumesTestJSON-1385041480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-403e1e49-aaab-4ca8-9ba2-ff2a5bb4b68a {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:15 devstack sudo[93242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-403e1e49-aaab-4ca8-9ba2-ff2a5bb4b68a Jul 10 18:12:15 devstack sudo[93242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:16 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d27a71ee-cc03-4043-a335-c2ea0b984efc tempest-VolumesTestJSON-1385041480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.944s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:16 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-d27a71ee-cc03-4043-a335-c2ea0b984efc tempest-VolumesTestJSON-1385041480 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:12:16 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-d27a71ee-cc03-4043-a335-c2ea0b984efc tempest-VolumesTestJSON-1385041480 None] Deleted volume successfully. Jul 10 18:12:16 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d27a71ee-cc03-4043-a335-c2ea0b984efc tempest-VolumesTestJSON-1385041480 None] Lock "cinder-b75301a3-096e-48f2-a0fd-ec078fcd0afe-delete_volume" released by "delete_volume" :: held 3.159s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:12:16 devstack sudo[93239]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d04b4f99-8d8d-4f27-9bcc-53a546e98190 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0.info" returned: 0 in 1.332s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:16 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-d04b4f99-8d8d-4f27-9bcc-53a546e98190 tempest-VolumesSnapshotTestJSON-907745065 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0.info is being set with open permissions: ugo+rw Jul 10 18:12:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d04b4f99-8d8d-4f27-9bcc-53a546e98190 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:16 devstack sudo[93247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0.info Jul 10 18:12:16 devstack sudo[93247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:16 devstack sudo[93242]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0adb204a-29c7-4380-895f-328e24f9746d tempest-VolumesTestJSON-1385041480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-403e1e49-aaab-4ca8-9ba2-ff2a5bb4b68a" returned: 0 in 1.212s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0adb204a-29c7-4380-895f-328e24f9746d tempest-VolumesTestJSON-1385041480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-403e1e49-aaab-4ca8-9ba2-ff2a5bb4b68a {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:16 devstack sudo[93251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-403e1e49-aaab-4ca8-9ba2-ff2a5bb4b68a Jul 10 18:12:16 devstack sudo[93251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:17 devstack sudo[93247]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d04b4f99-8d8d-4f27-9bcc-53a546e98190 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0.info" returned: 0 in 0.894s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d04b4f99-8d8d-4f27-9bcc-53a546e98190 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.275s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:12:17 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-d04b4f99-8d8d-4f27-9bcc-53a546e98190 tempest-VolumesSnapshotTestJSON-907745065 None] Create snapshot completed successfully Jul 10 18:12:17 devstack sudo[93251]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0adb204a-29c7-4380-895f-328e24f9746d tempest-VolumesTestJSON-1385041480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-403e1e49-aaab-4ca8-9ba2-ff2a5bb4b68a" returned: 0 in 0.901s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:17 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0adb204a-29c7-4380-895f-328e24f9746d tempest-VolumesTestJSON-1385041480 None] Lock "cinder-quobyte-403e1e49-aaab-4ca8-9ba2-ff2a5bb4b68a" released by "delete_volume" :: held 2.205s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:12:17 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-0adb204a-29c7-4380-895f-328e24f9746d tempest-VolumesTestJSON-1385041480 None] Created reservations ['54a12f01-b7d3-423b-a577-685509b041ad', '6cb06cad-b3e3-4dcf-9a4a-a57499dd224e', 'c97477db-c1ad-4b76-bf6d-f97ecec1484a', 'ce8126eb-41de-4e8a-879e-bfcc90735333'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:12:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0adb204a-29c7-4380-895f-328e24f9746d tempest-VolumesTestJSON-1385041480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:12:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0adb204a-29c7-4380-895f-328e24f9746d tempest-VolumesTestJSON-1385041480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:12:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0adb204a-29c7-4380-895f-328e24f9746d tempest-VolumesTestJSON-1385041480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:12:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0adb204a-29c7-4380-895f-328e24f9746d tempest-VolumesTestJSON-1385041480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:12:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0adb204a-29c7-4380-895f-328e24f9746d tempest-VolumesTestJSON-1385041480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:12:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0adb204a-29c7-4380-895f-328e24f9746d tempest-VolumesTestJSON-1385041480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:17 devstack sudo[93255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:12:17 devstack sudo[93255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:18 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-fb650fae-54b0-4fac-a446-1ea5b2f07b47 tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "cinder-43bd64a0-01a4-4aa5-a556-bad76f6c175c-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:12:18 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-fb650fae-54b0-4fac-a446-1ea5b2f07b47 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-43bd64a0-01a4-4aa5-a556-bad76f6c175c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:12:18 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-fb650fae-54b0-4fac-a446-1ea5b2f07b47 tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "cinder-quobyte-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:12:18 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-fb650fae-54b0-4fac-a446-1ea5b2f07b47 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-quobyte-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:12:18 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-fb650fae-54b0-4fac-a446-1ea5b2f07b47 tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "cinder-quobyte-43bd64a0-01a4-4aa5-a556-bad76f6c175c" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:12:18 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-fb650fae-54b0-4fac-a446-1ea5b2f07b47 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-quobyte-43bd64a0-01a4-4aa5-a556-bad76f6c175c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:12:18 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-fb650fae-54b0-4fac-a446-1ea5b2f07b47 tempest-VolumesSnapshotTestJSON-907745065 None] Deleting offline snapshot 43bd64a0-01a4-4aa5-a556-bad76f6c175c of volume 9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:12:18 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-fb650fae-54b0-4fac-a446-1ea5b2f07b47 tempest-VolumesSnapshotTestJSON-907745065 None] snapshot_file for this snap is: volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0.43bd64a0-01a4-4aa5-a556-bad76f6c175c {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:12:18 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cc6e63-2127-459a-b417-9542b090421d]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:12:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fb650fae-54b0-4fac-a446-1ea5b2f07b47 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0.43bd64a0-01a4-4aa5-a556-bad76f6c175c {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:18 devstack sudo[93258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0.43bd64a0-01a4-4aa5-a556-bad76f6c175c Jul 10 18:12:18 devstack sudo[93258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:18 devstack sudo[93255]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0adb204a-29c7-4380-895f-328e24f9746d tempest-VolumesTestJSON-1385041480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.954s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:18 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-0adb204a-29c7-4380-895f-328e24f9746d tempest-VolumesTestJSON-1385041480 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:12:18 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-0adb204a-29c7-4380-895f-328e24f9746d tempest-VolumesTestJSON-1385041480 None] Deleted volume successfully. Jul 10 18:12:18 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f17bf78b-e078-481e-b181-e9af72872d5a tempest-VolumesTestJSON-1385041480 None] Acquiring lock "cinder-d743ebcc-1c27-4359-a7ed-6f6266b35a62-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:12:18 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0adb204a-29c7-4380-895f-328e24f9746d tempest-VolumesTestJSON-1385041480 None] Lock "cinder-403e1e49-aaab-4ca8-9ba2-ff2a5bb4b68a-delete_volume" released by "delete_volume" :: held 3.535s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:12:18 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f17bf78b-e078-481e-b181-e9af72872d5a tempest-VolumesTestJSON-1385041480 None] Lock "cinder-d743ebcc-1c27-4359-a7ed-6f6266b35a62-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:12:18 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f17bf78b-e078-481e-b181-e9af72872d5a tempest-VolumesTestJSON-1385041480 None] Acquiring lock "cinder-quobyte-d743ebcc-1c27-4359-a7ed-6f6266b35a62" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:12:18 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f17bf78b-e078-481e-b181-e9af72872d5a tempest-VolumesTestJSON-1385041480 None] Lock "cinder-quobyte-d743ebcc-1c27-4359-a7ed-6f6266b35a62" acquired by "delete_volume" :: waited 0.021s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:12:18 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[25654e50-621a-45e7-80e0-19c86adb8828]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:12:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f17bf78b-e078-481e-b181-e9af72872d5a tempest-VolumesTestJSON-1385041480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d743ebcc-1c27-4359-a7ed-6f6266b35a62 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:19 devstack sudo[93260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d743ebcc-1c27-4359-a7ed-6f6266b35a62 Jul 10 18:12:19 devstack sudo[93260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:19 devstack sudo[93258]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fb650fae-54b0-4fac-a446-1ea5b2f07b47 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0.43bd64a0-01a4-4aa5-a556-bad76f6c175c" returned: 0 in 1.192s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:19 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-fb650fae-54b0-4fac-a446-1ea5b2f07b47 tempest-VolumesSnapshotTestJSON-907745065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:12:19 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[a81fe002-8952-416a-bd91-76823d8b57ba]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:12:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fb650fae-54b0-4fac-a446-1ea5b2f07b47 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:19 devstack sudo[93265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0 Jul 10 18:12:19 devstack sudo[93265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:19 devstack sudo[93260]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f17bf78b-e078-481e-b181-e9af72872d5a tempest-VolumesTestJSON-1385041480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d743ebcc-1c27-4359-a7ed-6f6266b35a62" returned: 0 in 1.020s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f17bf78b-e078-481e-b181-e9af72872d5a tempest-VolumesTestJSON-1385041480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d743ebcc-1c27-4359-a7ed-6f6266b35a62 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:20 devstack sudo[93270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d743ebcc-1c27-4359-a7ed-6f6266b35a62 Jul 10 18:12:20 devstack sudo[93270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:20 devstack sudo[93265]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fb650fae-54b0-4fac-a446-1ea5b2f07b47 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0" returned: 0 in 1.220s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fb650fae-54b0-4fac-a446-1ea5b2f07b47 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0.43bd64a0-01a4-4aa5-a556-bad76f6c175c {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:20 devstack sudo[93270]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:20 devstack sudo[93276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0.43bd64a0-01a4-4aa5-a556-bad76f6c175c Jul 10 18:12:20 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f17bf78b-e078-481e-b181-e9af72872d5a tempest-VolumesTestJSON-1385041480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d743ebcc-1c27-4359-a7ed-6f6266b35a62" returned: 0 in 0.950s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:20 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f17bf78b-e078-481e-b181-e9af72872d5a tempest-VolumesTestJSON-1385041480 None] Lock "cinder-quobyte-d743ebcc-1c27-4359-a7ed-6f6266b35a62" released by "delete_volume" :: held 2.034s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:12:21 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-f17bf78b-e078-481e-b181-e9af72872d5a tempest-VolumesTestJSON-1385041480 None] Created reservations ['dd87bda2-58fb-4154-8c00-87a3ebae2a5d', '036ee2d7-f5cc-4bbc-903d-f57399786034', '4629d4c3-dec8-4d17-b125-7bf2b671dfed', '6b9676a1-fe75-4386-8760-e90aa57cb074'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:12:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f17bf78b-e078-481e-b181-e9af72872d5a tempest-VolumesTestJSON-1385041480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:12:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f17bf78b-e078-481e-b181-e9af72872d5a tempest-VolumesTestJSON-1385041480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:12:21 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f17bf78b-e078-481e-b181-e9af72872d5a tempest-VolumesTestJSON-1385041480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:12:21 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f17bf78b-e078-481e-b181-e9af72872d5a tempest-VolumesTestJSON-1385041480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:12:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f17bf78b-e078-481e-b181-e9af72872d5a tempest-VolumesTestJSON-1385041480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:12:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f17bf78b-e078-481e-b181-e9af72872d5a tempest-VolumesTestJSON-1385041480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:21 devstack sudo[93278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:12:21 devstack sudo[93278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:21 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fb650fae-54b0-4fac-a446-1ea5b2f07b47 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0.43bd64a0-01a4-4aa5-a556-bad76f6c175c" returned: 0 in 1.012s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fb650fae-54b0-4fac-a446-1ea5b2f07b47 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0.43bd64a0-01a4-4aa5-a556-bad76f6c175c {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:21 devstack sudo[93287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0.43bd64a0-01a4-4aa5-a556-bad76f6c175c Jul 10 18:12:21 devstack sudo[93287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:22 devstack sudo[93278]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f17bf78b-e078-481e-b181-e9af72872d5a tempest-VolumesTestJSON-1385041480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.904s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:22 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-f17bf78b-e078-481e-b181-e9af72872d5a tempest-VolumesTestJSON-1385041480 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:12:22 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-f17bf78b-e078-481e-b181-e9af72872d5a tempest-VolumesTestJSON-1385041480 None] Deleted volume successfully. Jul 10 18:12:22 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f17bf78b-e078-481e-b181-e9af72872d5a tempest-VolumesTestJSON-1385041480 None] Lock "cinder-d743ebcc-1c27-4359-a7ed-6f6266b35a62-delete_volume" released by "delete_volume" :: held 3.238s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:12:22 devstack sudo[93287]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fb650fae-54b0-4fac-a446-1ea5b2f07b47 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0.43bd64a0-01a4-4aa5-a556-bad76f6c175c" returned: 0 in 0.903s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:22 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-fb650fae-54b0-4fac-a446-1ea5b2f07b47 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-quobyte-43bd64a0-01a4-4aa5-a556-bad76f6c175c" released by "_delete_snapshot" :: held 4.494s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:12:22 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-fb650fae-54b0-4fac-a446-1ea5b2f07b47 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-quobyte-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0" released by "delete_snapshot" :: held 4.526s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:12:22 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-fb650fae-54b0-4fac-a446-1ea5b2f07b47 tempest-VolumesSnapshotTestJSON-907745065 None] Created reservations ['cad84709-897d-452f-a316-6040b4b07c16', 'd6275ce4-d438-45fc-bd56-0b490bbd52f7', 'b16136f3-585f-4b7e-adbb-40281b18b4df', 'cba91561-be66-4fca-866d-3a0a05efcfac'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:12:23 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-fb650fae-54b0-4fac-a446-1ea5b2f07b47 tempest-VolumesSnapshotTestJSON-907745065 None] Delete snapshot completed successfully. Jul 10 18:12:23 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-fb650fae-54b0-4fac-a446-1ea5b2f07b47 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-43bd64a0-01a4-4aa5-a556-bad76f6c175c-delete_snapshot" released by "delete_snapshot" :: held 4.781s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:12:24 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:12:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] Flow 'volume_create_manager' (9f96bc70-f5c3-41f5-91d9-55938925407c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:12:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0644d7c1-15a3-4156-803b-67d869198e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0644d7c1-15a3-4156-803b-67d869198e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1340147105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=669994af-ac21-431b-8792-02936b8d0f80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3512d33aea1f4adcbdcebee20b26e02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:12:24Z,use_quota=True,user_id='e55c9bd52bc14d8f9743a588bcf2c85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8715748-ffc4-4d05-9bb2-b6980cdf57fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8715748-ffc4-4d05-9bb2-b6980cdf57fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba523a3f-7e2c-4e47-9dcd-05c8ac0b40c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba523a3f-7e2c-4e47-9dcd-05c8ac0b40c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '669994af-ac21-431b-8792-02936b8d0f80', 'volume_name': 'volume-669994af-ac21-431b-8792-02936b8d0f80', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12184b1-34d2-4f54-a614-2d2d7f6715a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12184b1-34d2-4f54-a614-2d2d7f6715a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7705c469-9244-4f87-8cec-53a22eb13f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:24 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] Volume 669994af-ac21-431b-8792-02936b8d0f80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-669994af-ac21-431b-8792-02936b8d0f80', 'volume_size': 1} Jul 10 18:12:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:12:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:12:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1340147105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=669994af-ac21-431b-8792-02936b8d0f80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3512d33aea1f4adcbdcebee20b26e02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:12:24Z,use_quota=True,user_id='e55c9bd52bc14d8f9743a588bcf2c85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:12:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] Creating volume 669994af-ac21-431b-8792-02936b8d0f80 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:12:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:12:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:12:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:12:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:12:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:12:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:12:24 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:12:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:24 devstack sudo[93290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80 1073741824 Jul 10 18:12:24 devstack sudo[93290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:25 devstack sudo[93290]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80 1073741824" returned: 0 in 1.194s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:25 devstack sudo[93297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80 Jul 10 18:12:25 devstack sudo[93297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:26 devstack sudo[93297]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80" returned: 0 in 0.859s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:26 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] <== create_volume: return (2125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:12:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.128s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:12:26 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7705c469-9244-4f87-8cec-53a22eb13f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-669994af-ac21-431b-8792-02936b8d0f80', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:26 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11b79379-9a2b-41f1-a10d-050ff8d82754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:26 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] Volume volume-669994af-ac21-431b-8792-02936b8d0f80 (669994af-ac21-431b-8792-02936b8d0f80): created successfully Jul 10 18:12:26 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11b79379-9a2b-41f1-a10d-050ff8d82754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:26 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] Flow 'volume_create_manager' (9f96bc70-f5c3-41f5-91d9-55938925407c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:12:26 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-e99cfff3-ec95-4aa7-bd58-261bf338f4d5 tempest-VolumesSnapshotTestJSON-907745065 None] Created volume successfully. Jul 10 18:12:27 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-df241a52-f45c-4de4-931a-b14c5d6da828 tempest-GroupSnapshotsV319Test-1469577603 None] Group tempest-GroupSnapshotsV319Test-Group-1920526773: creating Jul 10 18:12:27 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-df241a52-f45c-4de4-931a-b14c5d6da828 tempest-GroupSnapshotsV319Test-1469577603 None] Group tempest-GroupSnapshotsV319Test-Group-1920526773: created successfully Jul 10 18:12:27 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-df241a52-f45c-4de4-931a-b14c5d6da828 tempest-GroupSnapshotsV319Test-1469577603 None] Create group completed successfully. Jul 10 18:12:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c797d745-6875-4465-b3fd-a5c0e18df783 tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:12:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c797d745-6875-4465-b3fd-a5c0e18df783 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:12:27 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-c797d745-6875-4465-b3fd-a5c0e18df783 tempest-VolumesSnapshotTestJSON-907745065 None] Creating offline snapshot 768eff42-39ef-4951-9175-3262af343eb1 of volume 669994af-ac21-431b-8792-02936b8d0f80 {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:12:27 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb314d2-7041-4210-99c5-38edea96dc99]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:12:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c797d745-6875-4465-b3fd-a5c0e18df783 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:28 devstack sudo[93301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80 Jul 10 18:12:28 devstack sudo[93301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:28 devstack sudo[93301]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c797d745-6875-4465-b3fd-a5c0e18df783 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80" returned: 0 in 0.883s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c797d745-6875-4465-b3fd-a5c0e18df783 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80.768eff42-39ef-4951-9175-3262af343eb1 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:28 devstack sudo[93309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80.768eff42-39ef-4951-9175-3262af343eb1 1G Jul 10 18:12:28 devstack sudo[93309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:29 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:12:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] Flow 'volume_create_manager' (94069872-8b48-4b53-972d-db4360b75559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:12:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b6ed66d-2dfd-4baf-a5dc-fc92f0165d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b6ed66d-2dfd-4baf-a5dc-fc92f0165d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-117844442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fe00c18e-d248-466f-abac-92c04c538225,host='devstack@QuobyteHD#QuobyteHD',id=464dbd2c-4de7-4575-81b4-75e01b19ffa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9f576d4e1794b7e8c1e263bdd63e628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:12:29Z,use_quota=True,user_id='05da181546534ad4b66c2a7360c45d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(122e8489-72fa-4b01-a836-991f9dc21dbe),volume_type_id=122e8489-72fa-4b01-a836-991f9dc21dbe)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf73358-ac54-4fb3-a5b1-adb141e55e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf73358-ac54-4fb3-a5b1-adb141e55e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f4a4897-4828-40cc-972e-2e3eda5b0d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f4a4897-4828-40cc-972e-2e3eda5b0d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '464dbd2c-4de7-4575-81b4-75e01b19ffa4', 'volume_name': 'volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ab3c34-d6d6-4ad2-aee6-974483a385a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ab3c34-d6d6-4ad2-aee6-974483a385a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9dcbd43-e780-401f-b977-3962c9dc7bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:29 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] Volume 464dbd2c-4de7-4575-81b4-75e01b19ffa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4', 'volume_size': 1} Jul 10 18:12:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:12:30 devstack sudo[93309]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c797d745-6875-4465-b3fd-a5c0e18df783 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80.768eff42-39ef-4951-9175-3262af343eb1 1G" returned: 0 in 1.380s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c797d745-6875-4465-b3fd-a5c0e18df783 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-669994af-ac21-431b-8792-02936b8d0f80 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80.768eff42-39ef-4951-9175-3262af343eb1 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:30 devstack sudo[93316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-669994af-ac21-431b-8792-02936b8d0f80 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80.768eff42-39ef-4951-9175-3262af343eb1 Jul 10 18:12:30 devstack sudo[93316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:30 devstack sudo[93316]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c797d745-6875-4465-b3fd-a5c0e18df783 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-669994af-ac21-431b-8792-02936b8d0f80 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80.768eff42-39ef-4951-9175-3262af343eb1" returned: 0 in 0.805s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:30 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-c797d745-6875-4465-b3fd-a5c0e18df783 tempest-VolumesSnapshotTestJSON-907745065 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80.768eff42-39ef-4951-9175-3262af343eb1 is being set with open permissions: ugo+rw Jul 10 18:12:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c797d745-6875-4465-b3fd-a5c0e18df783 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80.768eff42-39ef-4951-9175-3262af343eb1 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:30 devstack sudo[93321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80.768eff42-39ef-4951-9175-3262af343eb1 Jul 10 18:12:30 devstack sudo[93321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:31 devstack sudo[93321]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c797d745-6875-4465-b3fd-a5c0e18df783 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80.768eff42-39ef-4951-9175-3262af343eb1" returned: 0 in 0.707s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c797d745-6875-4465-b3fd-a5c0e18df783 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:31 devstack sudo[93324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80.info Jul 10 18:12:31 devstack sudo[93324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:32 devstack sudo[93324]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c797d745-6875-4465-b3fd-a5c0e18df783 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80.info" returned: 0 in 0.738s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:32 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-c797d745-6875-4465-b3fd-a5c0e18df783 tempest-VolumesSnapshotTestJSON-907745065 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80.info is being set with open permissions: ugo+rw Jul 10 18:12:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c797d745-6875-4465-b3fd-a5c0e18df783 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:32 devstack sudo[93328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80.info Jul 10 18:12:32 devstack sudo[93328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:33 devstack sudo[93328]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c797d745-6875-4465-b3fd-a5c0e18df783 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80.info" returned: 0 in 0.718s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c797d745-6875-4465-b3fd-a5c0e18df783 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.348s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:12:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.646s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:12:33 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fe00c18e-d248-466f-abac-92c04c538225,created_at=2026-07-10T16:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-117844442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fe00c18e-d248-466f-abac-92c04c538225,host='devstack@QuobyteHD#QuobyteHD',id=464dbd2c-4de7-4575-81b4-75e01b19ffa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9f576d4e1794b7e8c1e263bdd63e628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:12:29Z,use_quota=True,user_id='05da181546534ad4b66c2a7360c45d19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(122e8489-72fa-4b01-a836-991f9dc21dbe),volume_type_id=122e8489-72fa-4b01-a836-991f9dc21dbe)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:12:33 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] Creating volume 464dbd2c-4de7-4575-81b4-75e01b19ffa4 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:12:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:12:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:12:33 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:12:33 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:12:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:12:33 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:12:33 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:12:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:33 devstack sudo[93331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4 1073741824 Jul 10 18:12:33 devstack sudo[93331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:33 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-c797d745-6875-4465-b3fd-a5c0e18df783 tempest-VolumesSnapshotTestJSON-907745065 None] Create snapshot completed successfully Jul 10 18:12:34 devstack sudo[93331]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4 1073741824" returned: 0 in 1.141s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:34 devstack sudo[93337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4 Jul 10 18:12:34 devstack sudo[93337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Flow 'volume_create_manager' (e5389d91-3f82-4d2b-bcd2-bdda0b416ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5dff8d2-f858-4b00-bdad-798f9e4e0cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5dff8d2-f858-4b00-bdad-798f9e4e0cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1230634393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d20c6f-8f87-4cbb-b2b7-842ba4eaa863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3512d33aea1f4adcbdcebee20b26e02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:12:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=768eff42-39ef-4951-9175-3262af343eb1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:12:35Z,use_quota=True,user_id='e55c9bd52bc14d8f9743a588bcf2c85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872510e3-2259-4f46-9005-460eb13ba032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (872510e3-2259-4f46-9005-460eb13ba032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (580806f1-95c2-434c-8d09-953d92d10d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (580806f1-95c2-434c-8d09-953d92d10d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '05d20c6f-8f87-4cbb-b2b7-842ba4eaa863', 'volume_name': 'volume-05d20c6f-8f87-4cbb-b2b7-842ba4eaa863', 'volume_size': 2, 'snapshot_id': '768eff42-39ef-4951-9175-3262af343eb1'}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc421c22-ad8b-41e8-9123-f0a92df72227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc421c22-ad8b-41e8-9123-f0a92df72227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a26df14-abef-4e6a-b2fb-703a1d44ebe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:35 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Volume 05d20c6f-8f87-4cbb-b2b7-842ba4eaa863: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-05d20c6f-8f87-4cbb-b2b7-842ba4eaa863', 'volume_size': 2, 'snapshot_id': '768eff42-39ef-4951-9175-3262af343eb1'} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:12:35 devstack sudo[93337]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4" returned: 0 in 0.937s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] <== create_volume: return (2157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.169s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.142s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "cinder-quobyte-768eff42-39ef-4951-9175-3262af343eb1-05d20c6f-8f87-4cbb-b2b7-842ba4eaa863" by "_create_volume_from_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9dcbd43-e780-401f-b977-3962c9dc7bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a145cbf-c02f-4e1d-b7c0-4dbd3657eb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-quobyte-768eff42-39ef-4951-9175-3262af343eb1-05d20c6f-8f87-4cbb-b2b7-842ba4eaa863" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Creating volume 05d20c6f-8f87-4cbb-b2b7-842ba4eaa863 from snapshot 768eff42-39ef-4951-9175-3262af343eb1 {{(pid=87399) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "cinder-quobyte-05d20c6f-8f87-4cbb-b2b7-842ba4eaa863" by "_copy_volume_from_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:12:35 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] Volume volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4 (464dbd2c-4de7-4575-81b4-75e01b19ffa4): created successfully Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a145cbf-c02f-4e1d-b7c0-4dbd3657eb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] Flow 'volume_create_manager' (94069872-8b48-4b53-972d-db4360b75559) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-quobyte-05d20c6f-8f87-4cbb-b2b7-842ba4eaa863" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] snapshot: 768eff42-39ef-4951-9175-3262af343eb1, volume: 05d20c6f-8f87-4cbb-b2b7-842ba4eaa863, {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 18:12:35 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-485909f2-917d-4648-9806-ef2f67f46445 tempest-GroupSnapshotsV319Test-1469577603 None] Created volume successfully. Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[440765e4-ec58-4aa9-84de-19cd2b62eed7]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:12:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80.768eff42-39ef-4951-9175-3262af343eb1 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:35 devstack sudo[93347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80.768eff42-39ef-4951-9175-3262af343eb1 Jul 10 18:12:35 devstack sudo[93347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:36 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-c96a35f8-e367-44bd-9f72-87730b867679 tempest-GroupSnapshotsV319Test-1469577603 None] GroupSnapshot 839fd28e-cd54-4f65-8b4d-81e34a75f705: creating. Jul 10 18:12:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c96a35f8-e367-44bd-9f72-87730b867679 tempest-GroupSnapshotsV319Test-1469577603 None] Group snapshot 839fd28e-cd54-4f65-8b4d-81e34a75f705: creating. {{(pid=87399) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 18:12:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c96a35f8-e367-44bd-9f72-87730b867679 tempest-GroupSnapshotsV319Test-1469577603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:12:36 devstack sudo[93347]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80.768eff42-39ef-4951-9175-3262af343eb1" returned: 0 in 1.189s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-669994af-ac21-431b-8792-02936b8d0f80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:12:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] will copy from snapshot at /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80 {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 18:12:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Creating direct copy from snapshot {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 18:12:36 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[790afb00-c6df-4c89-81a6-eaab9d55343d]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:12:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:36 devstack sudo[93362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80 Jul 10 18:12:36 devstack sudo[93362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:37 devstack sudo[93362]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80" returned: 0 in 0.860s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:37 devstack cinder-volume[87399]: DEBUG cinder.utils [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Path /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-05d20c6f-8f87-4cbb-b2b7-842ba4eaa863 not found in is_blk_device check {{(pid=87399) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 18:12:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-05d20c6f-8f87-4cbb-b2b7-842ba4eaa863 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:37 devstack sudo[93371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-05d20c6f-8f87-4cbb-b2b7-842ba4eaa863 Jul 10 18:12:37 devstack sudo[93371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:44 devstack sudo[93371]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-05d20c6f-8f87-4cbb-b2b7-842ba4eaa863" returned: 0 in 6.765s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:44 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dda2ca0-8e29-49c3-b0a4-ef4087a44dba]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:12:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:44 devstack sudo[93489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80 Jul 10 18:12:44 devstack sudo[93489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:46 devstack sudo[93489]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80" returned: 0 in 1.619s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:46 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Image conversion details: src /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80, size 1024.00 MB, duration 6.77 sec, destination /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-05d20c6f-8f87-4cbb-b2b7-842ba4eaa863 {{(pid=87399) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 18:12:46 devstack cinder-volume[87399]: INFO cinder.image.image_utils [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Converted 1024.00 MB image at 151.31 MB/s Jul 10 18:12:46 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-05d20c6f-8f87-4cbb-b2b7-842ba4eaa863 is being set with open permissions: ugo+rw Jul 10 18:12:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-05d20c6f-8f87-4cbb-b2b7-842ba4eaa863 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:46 devstack sudo[93512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-05d20c6f-8f87-4cbb-b2b7-842ba4eaa863 Jul 10 18:12:46 devstack sudo[93512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:46 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=75,cinder:INSERT=23,cinder:UPDATE=96,cinder:DELETE=7 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:12:46 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=80,cinder:INSERT=22,cinder:UPDATE=89,cinder:DELETE=9 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:12:47 devstack sudo[93512]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-05d20c6f-8f87-4cbb-b2b7-842ba4eaa863" returned: 0 in 0.995s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:47 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-quobyte-05d20c6f-8f87-4cbb-b2b7-842ba4eaa863" released by "_copy_volume_from_snapshot" :: held 11.594s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:12:47 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-quobyte-768eff42-39ef-4951-9175-3262af343eb1-05d20c6f-8f87-4cbb-b2b7-842ba4eaa863" released by "_create_volume_from_snapshot" :: held 11.659s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:12:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.693s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:12:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c96a35f8-e367-44bd-9f72-87730b867679 tempest-GroupSnapshotsV319Test-1469577603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.651s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:12:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-c96a35f8-e367-44bd-9f72-87730b867679 tempest-GroupSnapshotsV319Test-1469577603 None] Creating offline snapshot f689d3ee-132e-4ad3-b7eb-4ab2388ea602 of volume 464dbd2c-4de7-4575-81b4-75e01b19ffa4 {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:12:47 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a26df14-abef-4e6a-b2fb-703a1d44ebe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05d20c6f-8f87-4cbb-b2b7-842ba4eaa863', 'volume_size': 2, 'snapshot_id': '768eff42-39ef-4951-9175-3262af343eb1'}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:47 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a139f2e-c626-469c-ab1a-ff05a8806ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:47 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e5b636-18f0-4595-af74-4634b6799d35]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:12:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c96a35f8-e367-44bd-9f72-87730b867679 tempest-GroupSnapshotsV319Test-1469577603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:47 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Volume volume-05d20c6f-8f87-4cbb-b2b7-842ba4eaa863 (05d20c6f-8f87-4cbb-b2b7-842ba4eaa863): created successfully Jul 10 18:12:47 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a139f2e-c626-469c-ab1a-ff05a8806ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:47 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Flow 'volume_create_manager' (e5389d91-3f82-4d2b-bcd2-bdda0b416ed3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:12:47 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-364361f3-30a8-4d51-8b72-d28693ad5d2a tempest-VolumesSnapshotTestJSON-907745065 None] Created volume successfully. Jul 10 18:12:47 devstack sudo[93518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4 Jul 10 18:12:47 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:47 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-efa572f2-5e3a-4a2c-b00c-9caae83f53c7 tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "cinder-05d20c6f-8f87-4cbb-b2b7-842ba4eaa863-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:12:47 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-efa572f2-5e3a-4a2c-b00c-9caae83f53c7 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-05d20c6f-8f87-4cbb-b2b7-842ba4eaa863-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:12:47 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-efa572f2-5e3a-4a2c-b00c-9caae83f53c7 tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "cinder-quobyte-05d20c6f-8f87-4cbb-b2b7-842ba4eaa863" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:12:47 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-efa572f2-5e3a-4a2c-b00c-9caae83f53c7 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-quobyte-05d20c6f-8f87-4cbb-b2b7-842ba4eaa863" acquired by "delete_volume" :: waited 0.016s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:12:47 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[70efd7f5-6726-40c7-bab0-109c39da4b6d]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:12:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-efa572f2-5e3a-4a2c-b00c-9caae83f53c7 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-05d20c6f-8f87-4cbb-b2b7-842ba4eaa863 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:47 devstack sudo[93520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-05d20c6f-8f87-4cbb-b2b7-842ba4eaa863 Jul 10 18:12:47 devstack sudo[93520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:48 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c96a35f8-e367-44bd-9f72-87730b867679 tempest-GroupSnapshotsV319Test-1469577603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4" returned: 0 in 1.087s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c96a35f8-e367-44bd-9f72-87730b867679 tempest-GroupSnapshotsV319Test-1469577603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4.f689d3ee-132e-4ad3-b7eb-4ab2388ea602 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:48 devstack sudo[93526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4.f689d3ee-132e-4ad3-b7eb-4ab2388ea602 1G Jul 10 18:12:48 devstack sudo[93526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:48 devstack sudo[93520]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-efa572f2-5e3a-4a2c-b00c-9caae83f53c7 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-05d20c6f-8f87-4cbb-b2b7-842ba4eaa863" returned: 0 in 0.937s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-efa572f2-5e3a-4a2c-b00c-9caae83f53c7 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-05d20c6f-8f87-4cbb-b2b7-842ba4eaa863 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:48 devstack sudo[93532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-05d20c6f-8f87-4cbb-b2b7-842ba4eaa863 Jul 10 18:12:48 devstack sudo[93532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:49 devstack sudo[93526]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c96a35f8-e367-44bd-9f72-87730b867679 tempest-GroupSnapshotsV319Test-1469577603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4.f689d3ee-132e-4ad3-b7eb-4ab2388ea602 1G" returned: 0 in 0.937s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c96a35f8-e367-44bd-9f72-87730b867679 tempest-GroupSnapshotsV319Test-1469577603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4.f689d3ee-132e-4ad3-b7eb-4ab2388ea602 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:49 devstack sudo[93537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4.f689d3ee-132e-4ad3-b7eb-4ab2388ea602 Jul 10 18:12:49 devstack sudo[93537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:49 devstack sudo[93532]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-efa572f2-5e3a-4a2c-b00c-9caae83f53c7 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-05d20c6f-8f87-4cbb-b2b7-842ba4eaa863" returned: 0 in 0.854s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:49 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-efa572f2-5e3a-4a2c-b00c-9caae83f53c7 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-quobyte-05d20c6f-8f87-4cbb-b2b7-842ba4eaa863" released by "delete_volume" :: held 1.833s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:12:49 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-efa572f2-5e3a-4a2c-b00c-9caae83f53c7 tempest-VolumesSnapshotTestJSON-907745065 None] Created reservations ['3bb383ed-7619-4279-81b2-938ebe16ae23', '266ea790-9f5d-4098-a222-93f403e2aaf7', '80882905-7227-4f31-b9bf-d4046791c4a3', '4e79dcfc-d296-438b-a307-392a74798b92'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:12:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-efa572f2-5e3a-4a2c-b00c-9caae83f53c7 tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:12:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-efa572f2-5e3a-4a2c-b00c-9caae83f53c7 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:12:49 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-efa572f2-5e3a-4a2c-b00c-9caae83f53c7 tempest-VolumesSnapshotTestJSON-907745065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:12:49 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-efa572f2-5e3a-4a2c-b00c-9caae83f53c7 tempest-VolumesSnapshotTestJSON-907745065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:12:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-efa572f2-5e3a-4a2c-b00c-9caae83f53c7 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:12:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-efa572f2-5e3a-4a2c-b00c-9caae83f53c7 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:49 devstack sudo[93540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:12:49 devstack sudo[93540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:49 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7de7267a-5f1a-4902-ab89-2f06802bfbe8 tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "cinder-768eff42-39ef-4951-9175-3262af343eb1-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:12:49 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7de7267a-5f1a-4902-ab89-2f06802bfbe8 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-768eff42-39ef-4951-9175-3262af343eb1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:12:49 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7de7267a-5f1a-4902-ab89-2f06802bfbe8 tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "cinder-quobyte-669994af-ac21-431b-8792-02936b8d0f80" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:12:49 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7de7267a-5f1a-4902-ab89-2f06802bfbe8 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-quobyte-669994af-ac21-431b-8792-02936b8d0f80" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:12:49 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7de7267a-5f1a-4902-ab89-2f06802bfbe8 tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "cinder-quobyte-768eff42-39ef-4951-9175-3262af343eb1" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:12:49 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7de7267a-5f1a-4902-ab89-2f06802bfbe8 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-quobyte-768eff42-39ef-4951-9175-3262af343eb1" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:12:49 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-7de7267a-5f1a-4902-ab89-2f06802bfbe8 tempest-VolumesSnapshotTestJSON-907745065 None] Deleting offline snapshot 768eff42-39ef-4951-9175-3262af343eb1 of volume 669994af-ac21-431b-8792-02936b8d0f80 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:12:50 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-7de7267a-5f1a-4902-ab89-2f06802bfbe8 tempest-VolumesSnapshotTestJSON-907745065 None] snapshot_file for this snap is: volume-669994af-ac21-431b-8792-02936b8d0f80.768eff42-39ef-4951-9175-3262af343eb1 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:12:50 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e762754-c94a-4ba6-a037-328d03b032c5]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:12:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7de7267a-5f1a-4902-ab89-2f06802bfbe8 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80.768eff42-39ef-4951-9175-3262af343eb1 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c96a35f8-e367-44bd-9f72-87730b867679 tempest-GroupSnapshotsV319Test-1469577603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4.f689d3ee-132e-4ad3-b7eb-4ab2388ea602" returned: 0 in 0.890s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:50 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-c96a35f8-e367-44bd-9f72-87730b867679 tempest-GroupSnapshotsV319Test-1469577603 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4.f689d3ee-132e-4ad3-b7eb-4ab2388ea602 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 18:12:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c96a35f8-e367-44bd-9f72-87730b867679 tempest-GroupSnapshotsV319Test-1469577603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4.f689d3ee-132e-4ad3-b7eb-4ab2388ea602 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:50 devstack sudo[93537]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:50 devstack sudo[93546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4.f689d3ee-132e-4ad3-b7eb-4ab2388ea602 Jul 10 18:12:50 devstack sudo[93546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:50 devstack sudo[93545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80.768eff42-39ef-4951-9175-3262af343eb1 Jul 10 18:12:50 devstack sudo[93545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:50 devstack sudo[93540]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-efa572f2-5e3a-4a2c-b00c-9caae83f53c7 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.216s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:50 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-efa572f2-5e3a-4a2c-b00c-9caae83f53c7 tempest-VolumesSnapshotTestJSON-907745065 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:12:50 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-efa572f2-5e3a-4a2c-b00c-9caae83f53c7 tempest-VolumesSnapshotTestJSON-907745065 None] Deleted volume successfully. Jul 10 18:12:50 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-efa572f2-5e3a-4a2c-b00c-9caae83f53c7 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-05d20c6f-8f87-4cbb-b2b7-842ba4eaa863-delete_volume" released by "delete_volume" :: held 3.377s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:12:51 devstack sudo[93546]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c96a35f8-e367-44bd-9f72-87730b867679 tempest-GroupSnapshotsV319Test-1469577603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4.f689d3ee-132e-4ad3-b7eb-4ab2388ea602" returned: 0 in 1.412s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c96a35f8-e367-44bd-9f72-87730b867679 tempest-GroupSnapshotsV319Test-1469577603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:51 devstack sudo[93596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4.info Jul 10 18:12:51 devstack sudo[93596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:51 devstack sudo[93545]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7de7267a-5f1a-4902-ab89-2f06802bfbe8 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80.768eff42-39ef-4951-9175-3262af343eb1" returned: 0 in 1.656s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:51 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-7de7267a-5f1a-4902-ab89-2f06802bfbe8 tempest-VolumesSnapshotTestJSON-907745065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-669994af-ac21-431b-8792-02936b8d0f80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:12:51 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bfe2e7-518e-4052-8198-ce5ae4d496ee]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:12:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7de7267a-5f1a-4902-ab89-2f06802bfbe8 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:51 devstack sudo[93601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80 Jul 10 18:12:51 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:52 devstack sudo[93596]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c96a35f8-e367-44bd-9f72-87730b867679 tempest-GroupSnapshotsV319Test-1469577603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4.info" returned: 0 in 0.926s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:52 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-c96a35f8-e367-44bd-9f72-87730b867679 tempest-GroupSnapshotsV319Test-1469577603 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 18:12:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c96a35f8-e367-44bd-9f72-87730b867679 tempest-GroupSnapshotsV319Test-1469577603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:52 devstack sudo[93628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4.info Jul 10 18:12:52 devstack sudo[93628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:52 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7de7267a-5f1a-4902-ab89-2f06802bfbe8 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80" returned: 0 in 1.134s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7de7267a-5f1a-4902-ab89-2f06802bfbe8 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80.768eff42-39ef-4951-9175-3262af343eb1 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:52 devstack sudo[93633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80.768eff42-39ef-4951-9175-3262af343eb1 Jul 10 18:12:52 devstack sudo[93633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:53 devstack sudo[93628]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c96a35f8-e367-44bd-9f72-87730b867679 tempest-GroupSnapshotsV319Test-1469577603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4.info" returned: 0 in 0.910s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c96a35f8-e367-44bd-9f72-87730b867679 tempest-GroupSnapshotsV319Test-1469577603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.314s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:12:53 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-c96a35f8-e367-44bd-9f72-87730b867679 tempest-GroupSnapshotsV319Test-1469577603 None] group_snapshot 839fd28e-cd54-4f65-8b4d-81e34a75f705: created successfully Jul 10 18:12:53 devstack sudo[93633]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7de7267a-5f1a-4902-ab89-2f06802bfbe8 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80.768eff42-39ef-4951-9175-3262af343eb1" returned: 0 in 1.035s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7de7267a-5f1a-4902-ab89-2f06802bfbe8 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80.768eff42-39ef-4951-9175-3262af343eb1 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:53 devstack sudo[93641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80.768eff42-39ef-4951-9175-3262af343eb1 Jul 10 18:12:53 devstack sudo[93641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:54 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-20e4c3f6-b925-42be-bedd-22ed661ba1db tempest-GroupSnapshotsV319Test-1469577603 None] group_snapshot 839fd28e-cd54-4f65-8b4d-81e34a75f705: deleting Jul 10 18:12:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-20e4c3f6-b925-42be-bedd-22ed661ba1db tempest-GroupSnapshotsV319Test-1469577603 None] group_snapshot 839fd28e-cd54-4f65-8b4d-81e34a75f705: deleting {{(pid=87399) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 18:12:54 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-20e4c3f6-b925-42be-bedd-22ed661ba1db tempest-GroupSnapshotsV319Test-1469577603 None] Acquiring lock "cinder-quobyte-464dbd2c-4de7-4575-81b4-75e01b19ffa4" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:12:54 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-20e4c3f6-b925-42be-bedd-22ed661ba1db tempest-GroupSnapshotsV319Test-1469577603 None] Lock "cinder-quobyte-464dbd2c-4de7-4575-81b4-75e01b19ffa4" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:12:54 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-20e4c3f6-b925-42be-bedd-22ed661ba1db tempest-GroupSnapshotsV319Test-1469577603 None] Acquiring lock "cinder-quobyte-f689d3ee-132e-4ad3-b7eb-4ab2388ea602" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:12:54 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-20e4c3f6-b925-42be-bedd-22ed661ba1db tempest-GroupSnapshotsV319Test-1469577603 None] Lock "cinder-quobyte-f689d3ee-132e-4ad3-b7eb-4ab2388ea602" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:12:54 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-20e4c3f6-b925-42be-bedd-22ed661ba1db tempest-GroupSnapshotsV319Test-1469577603 None] Deleting offline snapshot f689d3ee-132e-4ad3-b7eb-4ab2388ea602 of volume 464dbd2c-4de7-4575-81b4-75e01b19ffa4 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:12:54 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-20e4c3f6-b925-42be-bedd-22ed661ba1db tempest-GroupSnapshotsV319Test-1469577603 None] snapshot_file for this snap is: volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4.f689d3ee-132e-4ad3-b7eb-4ab2388ea602 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:12:54 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[259af5e5-8cbe-4477-bd61-a61532f61fbe]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:12:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-20e4c3f6-b925-42be-bedd-22ed661ba1db tempest-GroupSnapshotsV319Test-1469577603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4.f689d3ee-132e-4ad3-b7eb-4ab2388ea602 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:55 devstack sudo[93643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4.f689d3ee-132e-4ad3-b7eb-4ab2388ea602 Jul 10 18:12:55 devstack sudo[93643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:55 devstack sudo[93641]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7de7267a-5f1a-4902-ab89-2f06802bfbe8 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80.768eff42-39ef-4951-9175-3262af343eb1" returned: 0 in 1.255s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7de7267a-5f1a-4902-ab89-2f06802bfbe8 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-quobyte-768eff42-39ef-4951-9175-3262af343eb1" released by "_delete_snapshot" :: held 5.221s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:12:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7de7267a-5f1a-4902-ab89-2f06802bfbe8 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-quobyte-669994af-ac21-431b-8792-02936b8d0f80" released by "delete_snapshot" :: held 5.263s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:12:55 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-7de7267a-5f1a-4902-ab89-2f06802bfbe8 tempest-VolumesSnapshotTestJSON-907745065 None] Created reservations ['99eb2c67-962e-4e60-92f4-84dd87d796c6', '7adb277e-6a4f-4fbe-9c7f-35c9b18bb64a', 'd6d718d2-0df0-442c-8068-6b2379c303b7', '2d7172c5-af71-46c4-a9dd-696d31171a29'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:12:55 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-7de7267a-5f1a-4902-ab89-2f06802bfbe8 tempest-VolumesSnapshotTestJSON-907745065 None] Delete snapshot completed successfully. Jul 10 18:12:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7de7267a-5f1a-4902-ab89-2f06802bfbe8 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-768eff42-39ef-4951-9175-3262af343eb1-delete_snapshot" released by "delete_snapshot" :: held 5.562s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:12:55 devstack sudo[93643]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-20e4c3f6-b925-42be-bedd-22ed661ba1db tempest-GroupSnapshotsV319Test-1469577603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4.f689d3ee-132e-4ad3-b7eb-4ab2388ea602" returned: 0 in 1.068s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:55 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-20e4c3f6-b925-42be-bedd-22ed661ba1db tempest-GroupSnapshotsV319Test-1469577603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:12:55 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1831e0c-1377-4718-bdc8-7f26dd37c907]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:12:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-20e4c3f6-b925-42be-bedd-22ed661ba1db tempest-GroupSnapshotsV319Test-1469577603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:56 devstack sudo[93675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4 Jul 10 18:12:56 devstack sudo[93675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:56 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:12:56 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] Flow 'volume_create_manager' (5a5152a6-026d-45a1-95fc-4013a4ad2455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:12:56 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31bcd4ea-8f6a-46c3-9706-fcc11617e40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:56 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31bcd4ea-8f6a-46c3-9706-fcc11617e40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-22617537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42a6c41f-f150-4809-b016-ee4d6a99673e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9bd296b8f834c89aa8abaafebe49877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:12:56Z,use_quota=True,user_id='942029a3e59a452e8c06b57e0b54fcab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:56 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea04b2e3-cdbe-4c30-8928-9fd8dd0f567f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:56 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea04b2e3-cdbe-4c30-8928-9fd8dd0f567f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:56 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b42957-0c41-4ded-a89a-8dd9868fc962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:56 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b42957-0c41-4ded-a89a-8dd9868fc962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42a6c41f-f150-4809-b016-ee4d6a99673e', 'volume_name': 'volume-42a6c41f-f150-4809-b016-ee4d6a99673e', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:56 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c796413-a9fb-4ba7-9a2c-33323e4ba67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:56 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c796413-a9fb-4ba7-9a2c-33323e4ba67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:56 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae084c5-4a72-4f8d-93b1-d7fb4524b5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:56 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] Volume 42a6c41f-f150-4809-b016-ee4d6a99673e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42a6c41f-f150-4809-b016-ee4d6a99673e', 'volume_size': 1} Jul 10 18:12:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:12:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:12:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-22617537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42a6c41f-f150-4809-b016-ee4d6a99673e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9bd296b8f834c89aa8abaafebe49877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:12:56Z,use_quota=True,user_id='942029a3e59a452e8c06b57e0b54fcab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:12:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] Creating volume 42a6c41f-f150-4809-b016-ee4d6a99673e {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:12:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:12:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:12:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:12:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:12:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:12:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:12:56 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:12:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42a6c41f-f150-4809-b016-ee4d6a99673e 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:56 devstack sudo[93677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42a6c41f-f150-4809-b016-ee4d6a99673e 1073741824 Jul 10 18:12:56 devstack sudo[93677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:56 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ea6d5d62-93ff-48b8-bcbe-0fb71f7840b3 tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "cinder-669994af-ac21-431b-8792-02936b8d0f80-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:12:56 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ea6d5d62-93ff-48b8-bcbe-0fb71f7840b3 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-669994af-ac21-431b-8792-02936b8d0f80-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:12:56 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ea6d5d62-93ff-48b8-bcbe-0fb71f7840b3 tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "cinder-quobyte-669994af-ac21-431b-8792-02936b8d0f80" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:12:56 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ea6d5d62-93ff-48b8-bcbe-0fb71f7840b3 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-quobyte-669994af-ac21-431b-8792-02936b8d0f80" acquired by "delete_volume" :: waited 0.017s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:12:56 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[436f863c-4408-45d6-98ef-01bc59fcbe5e]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:12:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ea6d5d62-93ff-48b8-bcbe-0fb71f7840b3 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:56 devstack sudo[93679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80 Jul 10 18:12:56 devstack sudo[93679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:57 devstack sudo[93675]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-20e4c3f6-b925-42be-bedd-22ed661ba1db tempest-GroupSnapshotsV319Test-1469577603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4" returned: 0 in 1.069s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-20e4c3f6-b925-42be-bedd-22ed661ba1db tempest-GroupSnapshotsV319Test-1469577603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4.f689d3ee-132e-4ad3-b7eb-4ab2388ea602 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:57 devstack sudo[93684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4.f689d3ee-132e-4ad3-b7eb-4ab2388ea602 Jul 10 18:12:57 devstack sudo[93684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:57 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:12:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:12:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:12:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:12:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:12:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:12:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:57 devstack sudo[93691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:12:57 devstack sudo[93691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:57 devstack sudo[93679]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ea6d5d62-93ff-48b8-bcbe-0fb71f7840b3 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80" returned: 0 in 1.041s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ea6d5d62-93ff-48b8-bcbe-0fb71f7840b3 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:57 devstack sudo[93697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80 Jul 10 18:12:57 devstack sudo[93697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:57 devstack sudo[93677]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42a6c41f-f150-4809-b016-ee4d6a99673e 1073741824" returned: 0 in 1.435s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42a6c41f-f150-4809-b016-ee4d6a99673e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:58 devstack sudo[93701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42a6c41f-f150-4809-b016-ee4d6a99673e Jul 10 18:12:58 devstack sudo[93701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:58 devstack sudo[93684]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-20e4c3f6-b925-42be-bedd-22ed661ba1db tempest-GroupSnapshotsV319Test-1469577603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4.f689d3ee-132e-4ad3-b7eb-4ab2388ea602" returned: 0 in 1.032s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-20e4c3f6-b925-42be-bedd-22ed661ba1db tempest-GroupSnapshotsV319Test-1469577603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4.f689d3ee-132e-4ad3-b7eb-4ab2388ea602 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:58 devstack sudo[93703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4.f689d3ee-132e-4ad3-b7eb-4ab2388ea602 Jul 10 18:12:58 devstack sudo[93703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:58 devstack sudo[93691]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.966s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:58 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:12:58 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager._thread_info {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:12:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread count: 28 {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 18:12:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread info: [<_MainThread(MainThread, started 139757428633728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 18:12:58 devstack sudo[93697]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ea6d5d62-93ff-48b8-bcbe-0fb71f7840b3 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669994af-ac21-431b-8792-02936b8d0f80" returned: 0 in 0.857s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:58 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ea6d5d62-93ff-48b8-bcbe-0fb71f7840b3 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-quobyte-669994af-ac21-431b-8792-02936b8d0f80" released by "delete_volume" :: held 1.988s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:12:58 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-ea6d5d62-93ff-48b8-bcbe-0fb71f7840b3 tempest-VolumesSnapshotTestJSON-907745065 None] Created reservations ['b2034056-46ca-4863-8abd-7aa0a443a644', 'f7a57c11-528b-4db6-a254-46f35cb79db2', '762234f3-a471-431b-ab51-a9df19215791', '88520437-4ccb-44db-bc8c-54ce3552ef7e'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:12:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ea6d5d62-93ff-48b8-bcbe-0fb71f7840b3 tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:12:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ea6d5d62-93ff-48b8-bcbe-0fb71f7840b3 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:12:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ea6d5d62-93ff-48b8-bcbe-0fb71f7840b3 tempest-VolumesSnapshotTestJSON-907745065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:12:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ea6d5d62-93ff-48b8-bcbe-0fb71f7840b3 tempest-VolumesSnapshotTestJSON-907745065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:12:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ea6d5d62-93ff-48b8-bcbe-0fb71f7840b3 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:12:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ea6d5d62-93ff-48b8-bcbe-0fb71f7840b3 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:58 devstack sudo[93708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:12:58 devstack sudo[93708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:59 devstack sudo[93701]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42a6c41f-f150-4809-b016-ee4d6a99673e" returned: 0 in 1.072s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] <== create_volume: return (2589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.592s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:12:59 devstack sudo[93703]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-20e4c3f6-b925-42be-bedd-22ed661ba1db tempest-GroupSnapshotsV319Test-1469577603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4.f689d3ee-132e-4ad3-b7eb-4ab2388ea602" returned: 0 in 1.019s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae084c5-4a72-4f8d-93b1-d7fb4524b5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42a6c41f-f150-4809-b016-ee4d6a99673e', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce2439c-8ebb-49cc-aa26-1c05044082b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-20e4c3f6-b925-42be-bedd-22ed661ba1db tempest-GroupSnapshotsV319Test-1469577603 None] Lock "cinder-quobyte-f689d3ee-132e-4ad3-b7eb-4ab2388ea602" released by "_delete_snapshot" :: held 4.415s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-20e4c3f6-b925-42be-bedd-22ed661ba1db tempest-GroupSnapshotsV319Test-1469577603 None] Lock "cinder-quobyte-464dbd2c-4de7-4575-81b4-75e01b19ffa4" released by "delete_snapshot" :: held 4.475s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:12:59 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] Volume volume-42a6c41f-f150-4809-b016-ee4d6a99673e (42a6c41f-f150-4809-b016-ee4d6a99673e): created successfully Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce2439c-8ebb-49cc-aa26-1c05044082b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] Flow 'volume_create_manager' (5a5152a6-026d-45a1-95fc-4013a4ad2455) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:12:59 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-6efeda78-4e68-407a-b411-356bb76d3960 tempest-VolumesActionsTest-1492668241 None] Created volume successfully. Jul 10 18:12:59 devstack cinder-volume[87399]: WARNING cinder.quota [None req-20e4c3f6-b925-42be-bedd-22ed661ba1db tempest-GroupSnapshotsV319Test-1469577603 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1965996714 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1965996714, it is now deprecated. Please use the default quota class for default quota. Jul 10 18:12:59 devstack cinder-volume[87399]: WARNING cinder.quota [None req-20e4c3f6-b925-42be-bedd-22ed661ba1db tempest-GroupSnapshotsV319Test-1469577603 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1965996714 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1965996714, it is now deprecated. Please use the default quota class for default quota. Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-20e4c3f6-b925-42be-bedd-22ed661ba1db tempest-GroupSnapshotsV319Test-1469577603 None] Created reservations ['2a06e8d1-34be-40fc-864b-7a2ef59c1a89', '0adacc22-e6bb-4ce8-adac-3c6e1f6b7063', 'ab7e6400-9531-406d-9a7e-3187f08f770b', '7b30a927-9831-4ad1-b7ed-18ae840e6567'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:12:59 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-20e4c3f6-b925-42be-bedd-22ed661ba1db tempest-GroupSnapshotsV319Test-1469577603 None] group_snapshot 839fd28e-cd54-4f65-8b4d-81e34a75f705: deleted successfully Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-392e2457-83a9-4bea-9d60-daa9ccdefbb8 tempest-VolumesActionsTest-1492668241 None] Acquiring lock "cinder-42a6c41f-f150-4809-b016-ee4d6a99673e" by "attach_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-392e2457-83a9-4bea-9d60-daa9ccdefbb8 tempest-VolumesActionsTest-1492668241 None] Lock "cinder-42a6c41f-f150-4809-b016-ee4d6a99673e" acquired by "attach_volume" :: waited 0.025s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:12:59 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-392e2457-83a9-4bea-9d60-daa9ccdefbb8 tempest-VolumesActionsTest-1492668241 None] Attaching volume 42a6c41f-f150-4809-b016-ee4d6a99673e to instance 0c8c0400-34e7-4ab9-9ac9-f8ed049a2cb3 at mountpoint /dev/vdb on host None. Jul 10 18:12:59 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-392e2457-83a9-4bea-9d60-daa9ccdefbb8 tempest-VolumesActionsTest-1492668241 None] Attach volume completed successfully. Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] Flow 'volume_create_manager' (818bce9f-006f-4485-93f6-42c72d400cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6aa26c0-bdb6-49f6-ace5-61201ec08165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-392e2457-83a9-4bea-9d60-daa9ccdefbb8 tempest-VolumesActionsTest-1492668241 None] Lock "cinder-42a6c41f-f150-4809-b016-ee4d6a99673e" released by "attach_volume" :: held 0.147s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6aa26c0-bdb6-49f6-ace5-61201ec08165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1869414956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e66a96a-2099-4108-9db4-9cd21fd66c21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3512d33aea1f4adcbdcebee20b26e02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:13:00Z,use_quota=True,user_id='e55c9bd52bc14d8f9743a588bcf2c85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba31ecc-3417-4c06-afe2-b172fa5ddd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba31ecc-3417-4c06-afe2-b172fa5ddd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7f7a75b-6896-41b5-bc12-3e3d7e427b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7f7a75b-6896-41b5-bc12-3e3d7e427b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e66a96a-2099-4108-9db4-9cd21fd66c21', 'volume_name': 'volume-8e66a96a-2099-4108-9db4-9cd21fd66c21', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ced3939-7b73-451b-ba27-47d5a90285c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:59 devstack sudo[93708]: pam_unix(sudo:session): session closed for user root Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ced3939-7b73-451b-ba27-47d5a90285c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc554e13-0589-4b8c-a4d8-9e5efa1a3bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:12:59 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] Volume 8e66a96a-2099-4108-9db4-9cd21fd66c21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e66a96a-2099-4108-9db4-9cd21fd66c21', 'volume_size': 1} Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1869414956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e66a96a-2099-4108-9db4-9cd21fd66c21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3512d33aea1f4adcbdcebee20b26e02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:13:00Z,use_quota=True,user_id='e55c9bd52bc14d8f9743a588bcf2c85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] Creating volume 8e66a96a-2099-4108-9db4-9cd21fd66c21 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:12:59 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ea6d5d62-93ff-48b8-bcbe-0fb71f7840b3 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.071s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-ea6d5d62-93ff-48b8-bcbe-0fb71f7840b3 tempest-VolumesSnapshotTestJSON-907745065 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:12:59 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-ea6d5d62-93ff-48b8-bcbe-0fb71f7840b3 tempest-VolumesSnapshotTestJSON-907745065 None] Deleted volume successfully. Jul 10 18:12:59 devstack sudo[93718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21 1073741824 Jul 10 18:12:59 devstack sudo[93718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:12:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ea6d5d62-93ff-48b8-bcbe-0fb71f7840b3 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-669994af-ac21-431b-8792-02936b8d0f80-delete_volume" released by "delete_volume" :: held 3.316s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:00 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b3d0ce80-af2c-4ffd-a5a1-c82de1789d55 tempest-GroupSnapshotsV319Test-1469577603 None] Acquiring lock "cinder-quobyte-464dbd2c-4de7-4575-81b4-75e01b19ffa4" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:00 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b3d0ce80-af2c-4ffd-a5a1-c82de1789d55 tempest-GroupSnapshotsV319Test-1469577603 None] Lock "cinder-quobyte-464dbd2c-4de7-4575-81b4-75e01b19ffa4" acquired by "delete_volume" :: waited 0.027s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:00 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f6c71e-d864-4c7d-b8e4-007213ac5af1]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:13:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b3d0ce80-af2c-4ffd-a5a1-c82de1789d55 tempest-GroupSnapshotsV319Test-1469577603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:00 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-90b9f68d-39ec-4b3e-85e7-3846d14acfbe tempest-VolumesActionsTest-1279522215 None] Terminate volume connection completed successfully. Jul 10 18:13:00 devstack sudo[93723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4 Jul 10 18:13:00 devstack sudo[93723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:00 devstack sudo[93718]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21 1073741824" returned: 0 in 1.040s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:01 devstack sudo[93726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21 Jul 10 18:13:01 devstack sudo[93726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-90b9f68d-39ec-4b3e-85e7-3846d14acfbe tempest-VolumesActionsTest-1279522215 None] Acquiring lock "cinder-42a6c41f-f150-4809-b016-ee4d6a99673e-detach_volume" by "detach_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-90b9f68d-39ec-4b3e-85e7-3846d14acfbe tempest-VolumesActionsTest-1279522215 None] Lock "cinder-42a6c41f-f150-4809-b016-ee4d6a99673e-detach_volume" acquired by "detach_volume" :: waited 0.047s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:01 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-90b9f68d-39ec-4b3e-85e7-3846d14acfbe tempest-VolumesActionsTest-1279522215 None] Detaching volume 42a6c41f-f150-4809-b016-ee4d6a99673e from instance 0c8c0400-34e7-4ab9-9ac9-f8ed049a2cb3. Jul 10 18:13:01 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-90b9f68d-39ec-4b3e-85e7-3846d14acfbe tempest-VolumesActionsTest-1279522215 None] Detach volume completed successfully. Jul 10 18:13:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-90b9f68d-39ec-4b3e-85e7-3846d14acfbe tempest-VolumesActionsTest-1279522215 None] Lock "cinder-42a6c41f-f150-4809-b016-ee4d6a99673e-detach_volume" released by "detach_volume" :: held 0.117s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:01 devstack sudo[93723]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b3d0ce80-af2c-4ffd-a5a1-c82de1789d55 tempest-GroupSnapshotsV319Test-1469577603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4" returned: 0 in 0.983s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b3d0ce80-af2c-4ffd-a5a1-c82de1789d55 tempest-GroupSnapshotsV319Test-1469577603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:01 devstack sudo[93732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4 Jul 10 18:13:01 devstack sudo[93732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:01 devstack sudo[93726]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21" returned: 0 in 0.713s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:01 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] <== create_volume: return (1804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:13:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc554e13-0589-4b8c-a4d8-9e5efa1a3bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e66a96a-2099-4108-9db4-9cd21fd66c21', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dee8973-a158-4e42-9d1b-133350a10a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:01 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] Volume volume-8e66a96a-2099-4108-9db4-9cd21fd66c21 (8e66a96a-2099-4108-9db4-9cd21fd66c21): created successfully Jul 10 18:13:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dee8973-a158-4e42-9d1b-133350a10a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] Flow 'volume_create_manager' (818bce9f-006f-4485-93f6-42c72d400cc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:13:01 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-0ca3856b-fca7-44ef-9f52-91245f7b85e8 tempest-VolumesSnapshotTestJSON-907745065 None] Created volume successfully. Jul 10 18:13:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d51c2be9-53b5-4613-98d1-570bbd34042a tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d51c2be9-53b5-4613-98d1-570bbd34042a tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-d51c2be9-53b5-4613-98d1-570bbd34042a tempest-VolumesSnapshotTestJSON-907745065 None] Creating offline snapshot f8afbed0-2286-4d5e-8fa6-7b4cac6465b4 of volume 8e66a96a-2099-4108-9db4-9cd21fd66c21 {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:13:02 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab84e508-d5f2-45e5-86d7-b743c310e8db]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:13:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d51c2be9-53b5-4613-98d1-570bbd34042a tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f791a8cb-fcde-43e8-9968-2c32729b5af8 tempest-VolumesActionsTest-1492668241 None] Acquiring lock "cinder-42a6c41f-f150-4809-b016-ee4d6a99673e-detach_volume" by "detach_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f791a8cb-fcde-43e8-9968-2c32729b5af8 tempest-VolumesActionsTest-1492668241 None] Lock "cinder-42a6c41f-f150-4809-b016-ee4d6a99673e-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:02 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-f791a8cb-fcde-43e8-9968-2c32729b5af8 tempest-VolumesActionsTest-1492668241 None] Volume detach called, but volume not attached. Jul 10 18:13:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f791a8cb-fcde-43e8-9968-2c32729b5af8 tempest-VolumesActionsTest-1492668241 None] Lock "cinder-42a6c41f-f150-4809-b016-ee4d6a99673e-detach_volume" released by "detach_volume" :: held 0.048s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:02 devstack sudo[93734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21 Jul 10 18:13:02 devstack sudo[93734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:02 devstack sudo[93732]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b3d0ce80-af2c-4ffd-a5a1-c82de1789d55 tempest-GroupSnapshotsV319Test-1469577603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-464dbd2c-4de7-4575-81b4-75e01b19ffa4" returned: 0 in 1.062s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b3d0ce80-af2c-4ffd-a5a1-c82de1789d55 tempest-GroupSnapshotsV319Test-1469577603 None] Lock "cinder-quobyte-464dbd2c-4de7-4575-81b4-75e01b19ffa4" released by "delete_volume" :: held 2.121s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:02 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-b3d0ce80-af2c-4ffd-a5a1-c82de1789d55 tempest-GroupSnapshotsV319Test-1469577603 None] Created reservations ['081875aa-ac2a-499f-bb81-d75bc3eaabeb'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:13:02 devstack cinder-volume[87399]: WARNING cinder.quota [None req-b3d0ce80-af2c-4ffd-a5a1-c82de1789d55 tempest-GroupSnapshotsV319Test-1469577603 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1965996714 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1965996714, it is now deprecated. Please use the default quota class for default quota. Jul 10 18:13:02 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-b3d0ce80-af2c-4ffd-a5a1-c82de1789d55 tempest-GroupSnapshotsV319Test-1469577603 None] Created reservations ['c276b097-0549-485e-8f07-7be8afca5816', 'fb8e12cb-45db-43d1-8d03-546da91ccea5', 'ca986096-8727-4a1c-abb3-2b59337c2b50', 'd82f6c00-6a36-466e-a4cd-6fa6deac9ec1'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:13:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b3d0ce80-af2c-4ffd-a5a1-c82de1789d55 tempest-GroupSnapshotsV319Test-1469577603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b3d0ce80-af2c-4ffd-a5a1-c82de1789d55 tempest-GroupSnapshotsV319Test-1469577603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b3d0ce80-af2c-4ffd-a5a1-c82de1789d55 tempest-GroupSnapshotsV319Test-1469577603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:13:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b3d0ce80-af2c-4ffd-a5a1-c82de1789d55 tempest-GroupSnapshotsV319Test-1469577603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:13:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b3d0ce80-af2c-4ffd-a5a1-c82de1789d55 tempest-GroupSnapshotsV319Test-1469577603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b3d0ce80-af2c-4ffd-a5a1-c82de1789d55 tempest-GroupSnapshotsV319Test-1469577603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:03 devstack sudo[93737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:13:03 devstack sudo[93737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:03 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-00c3f564-1e7a-49ce-a7aa-fa67481766ae tempest-VolumesActionsTest-1492668241 None] Acquiring lock "cinder-42a6c41f-f150-4809-b016-ee4d6a99673e-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:03 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-00c3f564-1e7a-49ce-a7aa-fa67481766ae tempest-VolumesActionsTest-1492668241 None] Lock "cinder-42a6c41f-f150-4809-b016-ee4d6a99673e-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:03 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-00c3f564-1e7a-49ce-a7aa-fa67481766ae tempest-VolumesActionsTest-1492668241 None] Acquiring lock "cinder-quobyte-42a6c41f-f150-4809-b016-ee4d6a99673e" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:03 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-00c3f564-1e7a-49ce-a7aa-fa67481766ae tempest-VolumesActionsTest-1492668241 None] Lock "cinder-quobyte-42a6c41f-f150-4809-b016-ee4d6a99673e" acquired by "delete_volume" :: waited 0.068s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:03 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7b3726-91ed-402f-867e-e9b333edc26d]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:13:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-00c3f564-1e7a-49ce-a7aa-fa67481766ae tempest-VolumesActionsTest-1492668241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42a6c41f-f150-4809-b016-ee4d6a99673e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:03 devstack sudo[93734]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d51c2be9-53b5-4613-98d1-570bbd34042a tempest-VolumesSnapshotTestJSON-907745065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21" returned: 0 in 1.411s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d51c2be9-53b5-4613-98d1-570bbd34042a tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21.f8afbed0-2286-4d5e-8fa6-7b4cac6465b4 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:03 devstack sudo[93743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21.f8afbed0-2286-4d5e-8fa6-7b4cac6465b4 1G Jul 10 18:13:03 devstack sudo[93743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:04 devstack sudo[93742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42a6c41f-f150-4809-b016-ee4d6a99673e Jul 10 18:13:04 devstack sudo[93742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:04 devstack sudo[93737]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b3d0ce80-af2c-4ffd-a5a1-c82de1789d55 tempest-GroupSnapshotsV319Test-1469577603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.385s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:04 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-b3d0ce80-af2c-4ffd-a5a1-c82de1789d55 tempest-GroupSnapshotsV319Test-1469577603 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:13:04 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-b3d0ce80-af2c-4ffd-a5a1-c82de1789d55 tempest-GroupSnapshotsV319Test-1469577603 None] Delete group completed successfully. Jul 10 18:13:05 devstack sudo[93742]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-00c3f564-1e7a-49ce-a7aa-fa67481766ae tempest-VolumesActionsTest-1492668241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42a6c41f-f150-4809-b016-ee4d6a99673e" returned: 0 in 1.423s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-00c3f564-1e7a-49ce-a7aa-fa67481766ae tempest-VolumesActionsTest-1492668241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42a6c41f-f150-4809-b016-ee4d6a99673e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:05 devstack sudo[93755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42a6c41f-f150-4809-b016-ee4d6a99673e Jul 10 18:13:05 devstack sudo[93755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:05 devstack sudo[93743]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d51c2be9-53b5-4613-98d1-570bbd34042a tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21.f8afbed0-2286-4d5e-8fa6-7b4cac6465b4 1G" returned: 0 in 1.372s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d51c2be9-53b5-4613-98d1-570bbd34042a tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e66a96a-2099-4108-9db4-9cd21fd66c21 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21.f8afbed0-2286-4d5e-8fa6-7b4cac6465b4 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:05 devstack sudo[93757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e66a96a-2099-4108-9db4-9cd21fd66c21 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21.f8afbed0-2286-4d5e-8fa6-7b4cac6465b4 Jul 10 18:13:05 devstack sudo[93757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:05 devstack sudo[93755]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-00c3f564-1e7a-49ce-a7aa-fa67481766ae tempest-VolumesActionsTest-1492668241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42a6c41f-f150-4809-b016-ee4d6a99673e" returned: 0 in 0.895s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:06 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-00c3f564-1e7a-49ce-a7aa-fa67481766ae tempest-VolumesActionsTest-1492668241 None] Lock "cinder-quobyte-42a6c41f-f150-4809-b016-ee4d6a99673e" released by "delete_volume" :: held 2.384s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:06 devstack sudo[93757]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d51c2be9-53b5-4613-98d1-570bbd34042a tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e66a96a-2099-4108-9db4-9cd21fd66c21 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21.f8afbed0-2286-4d5e-8fa6-7b4cac6465b4" returned: 0 in 0.869s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:06 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-d51c2be9-53b5-4613-98d1-570bbd34042a tempest-VolumesSnapshotTestJSON-907745065 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21.f8afbed0-2286-4d5e-8fa6-7b4cac6465b4 is being set with open permissions: ugo+rw Jul 10 18:13:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d51c2be9-53b5-4613-98d1-570bbd34042a tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21.f8afbed0-2286-4d5e-8fa6-7b4cac6465b4 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:06 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-00c3f564-1e7a-49ce-a7aa-fa67481766ae tempest-VolumesActionsTest-1492668241 None] Created reservations ['fbca4ceb-d806-400a-ae53-61b43cca0c66', '1b72524e-34f4-4940-8a41-c4c37d4de863', '70f579ae-127d-4e56-9ee9-6a7d066a5447', 'fb7c90f3-a9ef-4785-983e-401a0a64170d'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:13:06 devstack sudo[93764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21.f8afbed0-2286-4d5e-8fa6-7b4cac6465b4 Jul 10 18:13:06 devstack sudo[93764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-00c3f564-1e7a-49ce-a7aa-fa67481766ae tempest-VolumesActionsTest-1492668241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-00c3f564-1e7a-49ce-a7aa-fa67481766ae tempest-VolumesActionsTest-1492668241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-00c3f564-1e7a-49ce-a7aa-fa67481766ae tempest-VolumesActionsTest-1492668241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:13:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-00c3f564-1e7a-49ce-a7aa-fa67481766ae tempest-VolumesActionsTest-1492668241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:13:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-00c3f564-1e7a-49ce-a7aa-fa67481766ae tempest-VolumesActionsTest-1492668241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-00c3f564-1e7a-49ce-a7aa-fa67481766ae tempest-VolumesActionsTest-1492668241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:06 devstack sudo[93766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:13:06 devstack sudo[93766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:07 devstack sudo[93764]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d51c2be9-53b5-4613-98d1-570bbd34042a tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21.f8afbed0-2286-4d5e-8fa6-7b4cac6465b4" returned: 0 in 1.107s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d51c2be9-53b5-4613-98d1-570bbd34042a tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:07 devstack sudo[93795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21.info Jul 10 18:13:07 devstack sudo[93795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:07 devstack sudo[93766]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-00c3f564-1e7a-49ce-a7aa-fa67481766ae tempest-VolumesActionsTest-1492668241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.131s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:07 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-00c3f564-1e7a-49ce-a7aa-fa67481766ae tempest-VolumesActionsTest-1492668241 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:13:07 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-00c3f564-1e7a-49ce-a7aa-fa67481766ae tempest-VolumesActionsTest-1492668241 None] Deleted volume successfully. Jul 10 18:13:07 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-00c3f564-1e7a-49ce-a7aa-fa67481766ae tempest-VolumesActionsTest-1492668241 None] Lock "cinder-42a6c41f-f150-4809-b016-ee4d6a99673e-delete_volume" released by "delete_volume" :: held 3.935s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:08 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:13:08 devstack sudo[93795]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] Flow 'volume_create_manager' (8c969a78-5fa4-4b90-a096-565e6891443b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:13:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9d1424-e4ae-4f04-bb9e-f0f1e5632a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d51c2be9-53b5-4613-98d1-570bbd34042a tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21.info" returned: 0 in 0.888s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:08 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-d51c2be9-53b5-4613-98d1-570bbd34042a tempest-VolumesSnapshotTestJSON-907745065 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21.info is being set with open permissions: ugo+rw Jul 10 18:13:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d51c2be9-53b5-4613-98d1-570bbd34042a tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e9d1424-e4ae-4f04-bb9e-f0f1e5632a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-612359459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbd606b2-9c33-4116-83f5-6968474061b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6544c1f8de84484948a0ad04f56400d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:13:08Z,use_quota=True,user_id='d509c372a958424c92a028fb1123dad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:08 devstack sudo[93798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21.info Jul 10 18:13:08 devstack sudo[93798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c56d41-debb-40ee-8807-94a33ec05316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c56d41-debb-40ee-8807-94a33ec05316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58719820-75c8-41b6-ae09-865007ad4f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58719820-75c8-41b6-ae09-865007ad4f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbd606b2-9c33-4116-83f5-6968474061b8', 'volume_name': 'volume-cbd606b2-9c33-4116-83f5-6968474061b8', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d42405-650f-466b-9a04-9521859a9bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d42405-650f-466b-9a04-9521859a9bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c5ebd6-aa92-4208-bae2-2185fb03b4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:08 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] Volume cbd606b2-9c33-4116-83f5-6968474061b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbd606b2-9c33-4116-83f5-6968474061b8', 'volume_size': 1} Jul 10 18:13:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:08 devstack sudo[93798]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d51c2be9-53b5-4613-98d1-570bbd34042a tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21.info" returned: 0 in 0.718s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d51c2be9-53b5-4613-98d1-570bbd34042a tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.543s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.674s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-612359459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbd606b2-9c33-4116-83f5-6968474061b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6544c1f8de84484948a0ad04f56400d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:13:08Z,use_quota=True,user_id='d509c372a958424c92a028fb1123dad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:13:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] Creating volume cbd606b2-9c33-4116-83f5-6968474061b8 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:13:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:13:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:13:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:13:08 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:13:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-cbd606b2-9c33-4116-83f5-6968474061b8 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:08 devstack sudo[93806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-cbd606b2-9c33-4116-83f5-6968474061b8 1073741824 Jul 10 18:13:08 devstack sudo[93806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:08 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-d51c2be9-53b5-4613-98d1-570bbd34042a tempest-VolumesSnapshotTestJSON-907745065 None] Create snapshot completed successfully Jul 10 18:13:10 devstack sudo[93806]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-cbd606b2-9c33-4116-83f5-6968474061b8 1073741824" returned: 0 in 1.145s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-cbd606b2-9c33-4116-83f5-6968474061b8 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:10 devstack sudo[93829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-cbd606b2-9c33-4116-83f5-6968474061b8 Jul 10 18:13:10 devstack sudo[93829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Flow 'volume_create_manager' (b1b07866-54f4-4e16-a30b-379c9275ff4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f90ace03-3de1-4bec-b47f-bc37e308fe5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f90ace03-3de1-4bec-b47f-bc37e308fe5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1272696675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9431089-77e3-44ad-8b1c-a3690e88e7e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3512d33aea1f4adcbdcebee20b26e02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f8afbed0-2286-4d5e-8fa6-7b4cac6465b4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:13:11Z,use_quota=True,user_id='e55c9bd52bc14d8f9743a588bcf2c85e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa32009-c90b-4a96-b80c-b411101c8847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa32009-c90b-4a96-b80c-b411101c8847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4397441b-733a-4376-9a05-6fff024ce584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4397441b-733a-4376-9a05-6fff024ce584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c9431089-77e3-44ad-8b1c-a3690e88e7e4', 'volume_name': 'volume-c9431089-77e3-44ad-8b1c-a3690e88e7e4', 'volume_size': 1, 'snapshot_id': 'f8afbed0-2286-4d5e-8fa6-7b4cac6465b4'}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e4d8ee-7e3f-4f3a-9a6c-a657cf76e07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e4d8ee-7e3f-4f3a-9a6c-a657cf76e07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d45457-3d22-4cc2-982e-d26c16b43caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:10 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Volume c9431089-77e3-44ad-8b1c-a3690e88e7e4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c9431089-77e3-44ad-8b1c-a3690e88e7e4', 'volume_size': 1, 'snapshot_id': 'f8afbed0-2286-4d5e-8fa6-7b4cac6465b4'} Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:10 devstack sudo[93829]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-cbd606b2-9c33-4116-83f5-6968474061b8" returned: 0 in 0.832s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] <== create_volume: return (2026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.029s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.024s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "cinder-quobyte-f8afbed0-2286-4d5e-8fa6-7b4cac6465b4-c9431089-77e3-44ad-8b1c-a3690e88e7e4" by "_create_volume_from_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14c5ebd6-aa92-4208-bae2-2185fb03b4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbd606b2-9c33-4116-83f5-6968474061b8', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856a87a6-a9ee-4e1f-b7af-caad72bd5cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-quobyte-f8afbed0-2286-4d5e-8fa6-7b4cac6465b4-c9431089-77e3-44ad-8b1c-a3690e88e7e4" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Creating volume c9431089-77e3-44ad-8b1c-a3690e88e7e4 from snapshot f8afbed0-2286-4d5e-8fa6-7b4cac6465b4 {{(pid=87399) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "cinder-quobyte-c9431089-77e3-44ad-8b1c-a3690e88e7e4" by "_copy_volume_from_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:10 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] Volume volume-cbd606b2-9c33-4116-83f5-6968474061b8 (cbd606b2-9c33-4116-83f5-6968474061b8): created successfully Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856a87a6-a9ee-4e1f-b7af-caad72bd5cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] Flow 'volume_create_manager' (8c969a78-5fa4-4b90-a096-565e6891443b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-quobyte-c9431089-77e3-44ad-8b1c-a3690e88e7e4" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:10 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] snapshot: f8afbed0-2286-4d5e-8fa6-7b4cac6465b4, volume: c9431089-77e3-44ad-8b1c-a3690e88e7e4, {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 18:13:11 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:13:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] Flow 'volume_create_manager' (13fcdc8e-438e-4917-9c33-a1350c919379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:13:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e3b434-3d6a-4968-aab3-cb3f8c209089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:11 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-e0e607d0-1a3f-41d6-a44a-6578d0b30210 tempest-AttachVolumeTestJSON-309313673 None] Created volume successfully. Jul 10 18:13:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e3b434-3d6a-4968-aab3-cb3f8c209089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1183847446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a41d35c-59d5-468b-bb2e-921439713980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2b6e2683f34bb7a8132f0dfcba5c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:13:11Z,use_quota=True,user_id='f4bd0d1d364a44a6b9f86f54c3ef600b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b5c697-1b19-4538-acb2-f041745e28cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b5c697-1b19-4538-acb2-f041745e28cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba16e64c-c420-491f-8921-0edee7590de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba16e64c-c420-491f-8921-0edee7590de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a41d35c-59d5-468b-bb2e-921439713980', 'volume_name': 'volume-8a41d35c-59d5-468b-bb2e-921439713980', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce664ea5-1508-48ae-9bf5-c1627dd20b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce664ea5-1508-48ae-9bf5-c1627dd20b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e96e32e9-005d-4124-a6a8-e131bf2e6f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:11 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] Volume 8a41d35c-59d5-468b-bb2e-921439713980: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a41d35c-59d5-468b-bb2e-921439713980', 'volume_size': 1} Jul 10 18:13:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:11 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:13:11 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:13:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:11 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[239e66e3-1e43-4968-af92-1e1b48ebab74]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:13:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21.f8afbed0-2286-4d5e-8fa6-7b4cac6465b4 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:11 devstack sudo[93833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21.f8afbed0-2286-4d5e-8fa6-7b4cac6465b4 Jul 10 18:13:11 devstack sudo[93833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:11 devstack sudo[93833]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21.f8afbed0-2286-4d5e-8fa6-7b4cac6465b4" returned: 0 in 0.821s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:11 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e66a96a-2099-4108-9db4-9cd21fd66c21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:13:11 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] will copy from snapshot at /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21 {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 18:13:11 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Creating direct copy from snapshot {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 18:13:11 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d717e72-e1f6-4d9e-9490-b246f1e3d704]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:13:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:12 devstack sudo[93842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21 Jul 10 18:13:12 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:12 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21" returned: 0 in 0.768s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:12 devstack cinder-volume[87399]: DEBUG cinder.utils [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Path /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9431089-77e3-44ad-8b1c-a3690e88e7e4 not found in is_blk_device check {{(pid=87399) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 18:13:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9431089-77e3-44ad-8b1c-a3690e88e7e4 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:12 devstack sudo[93847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9431089-77e3-44ad-8b1c-a3690e88e7e4 Jul 10 18:13:12 devstack sudo[93847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-6d91a156-c636-422e-b1d1-4c219e6b0cc7 req-2e15e8ab-0dac-4941-94ff-732a089f0582 tempest-AttachVolumeTestJSON-309313673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:16 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:13:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] Flow 'volume_create_manager' (74bcd2da-2be9-46df-8202-be5f48070f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:13:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc06b18-1182-4a8b-83f4-3274a7073998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcc06b18-1182-4a8b-83f4-3274a7073998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1643379052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba03ca1a-63e5-4c9d-b346-3ff16672ceaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9bd296b8f834c89aa8abaafebe49877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:13:16Z,use_quota=True,user_id='942029a3e59a452e8c06b57e0b54fcab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76eea46c-d6c6-4647-80ec-1fdc16711a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76eea46c-d6c6-4647-80ec-1fdc16711a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15893bd1-6d1b-4a21-96eb-7643647cd55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15893bd1-6d1b-4a21-96eb-7643647cd55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba03ca1a-63e5-4c9d-b346-3ff16672ceaf', 'volume_name': 'volume-ba03ca1a-63e5-4c9d-b346-3ff16672ceaf', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b80f68a5-2aaa-4ddb-bd7f-688db91897a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b80f68a5-2aaa-4ddb-bd7f-688db91897a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c21af4-340a-4801-867c-17293f4a6ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:16 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] Volume ba03ca1a-63e5-4c9d-b346-3ff16672ceaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba03ca1a-63e5-4c9d-b346-3ff16672ceaf', 'volume_size': 1} Jul 10 18:13:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:17 devstack sudo[93847]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9431089-77e3-44ad-8b1c-a3690e88e7e4" returned: 0 in 5.202s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:17 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fb3580-25a6-4eaa-a3d5-840a83861a49]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:13:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:18 devstack sudo[93870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21 Jul 10 18:13:18 devstack sudo[93870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:18 devstack sudo[93870]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21" returned: 0 in 0.915s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:18 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Image conversion details: src /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21, size 1024.00 MB, duration 5.20 sec, destination /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9431089-77e3-44ad-8b1c-a3690e88e7e4 {{(pid=87399) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 18:13:18 devstack cinder-volume[87399]: INFO cinder.image.image_utils [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Converted 1024.00 MB image at 196.81 MB/s Jul 10 18:13:18 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9431089-77e3-44ad-8b1c-a3690e88e7e4 is being set with open permissions: ugo+rw Jul 10 18:13:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9431089-77e3-44ad-8b1c-a3690e88e7e4 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:18 devstack sudo[93875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9431089-77e3-44ad-8b1c-a3690e88e7e4 Jul 10 18:13:18 devstack sudo[93875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:19 devstack sudo[93875]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9431089-77e3-44ad-8b1c-a3690e88e7e4" returned: 0 in 0.642s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:19 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-quobyte-c9431089-77e3-44ad-8b1c-a3690e88e7e4" released by "_copy_volume_from_snapshot" :: held 8.576s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:19 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-quobyte-f8afbed0-2286-4d5e-8fa6-7b4cac6465b4-c9431089-77e3-44ad-8b1c-a3690e88e7e4" released by "_create_volume_from_snapshot" :: held 8.626s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.662s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.447s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:19 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1183847446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a41d35c-59d5-468b-bb2e-921439713980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f2b6e2683f34bb7a8132f0dfcba5c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:13:11Z,use_quota=True,user_id='f4bd0d1d364a44a6b9f86f54c3ef600b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:13:19 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] Creating volume 8a41d35c-59d5-468b-bb2e-921439713980 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:13:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:19 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:13:19 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:13:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:19 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:13:19 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:13:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:19 devstack sudo[93878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980 1073741824 Jul 10 18:13:19 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61d45457-3d22-4cc2-982e-d26c16b43caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9431089-77e3-44ad-8b1c-a3690e88e7e4', 'volume_size': 1, 'snapshot_id': 'f8afbed0-2286-4d5e-8fa6-7b4cac6465b4'}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (544d6e20-c1f5-4ca4-9612-6ccbd24c022f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:19 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Volume volume-c9431089-77e3-44ad-8b1c-a3690e88e7e4 (c9431089-77e3-44ad-8b1c-a3690e88e7e4): created successfully Jul 10 18:13:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (544d6e20-c1f5-4ca4-9612-6ccbd24c022f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Flow 'volume_create_manager' (b1b07866-54f4-4e16-a30b-379c9275ff4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:13:19 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-b4d6920f-bf47-4915-9653-0645d152361c tempest-VolumesSnapshotTestJSON-907745065 None] Created volume successfully. Jul 10 18:13:20 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980 1073741824" returned: 0 in 0.843s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:20 devstack sudo[93885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980 Jul 10 18:13:20 devstack sudo[93885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:20 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d1590570-da57-432b-bc5f-6f0c9712148e tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "cinder-c9431089-77e3-44ad-8b1c-a3690e88e7e4-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:20 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d1590570-da57-432b-bc5f-6f0c9712148e tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-c9431089-77e3-44ad-8b1c-a3690e88e7e4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:20 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d1590570-da57-432b-bc5f-6f0c9712148e tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "cinder-quobyte-c9431089-77e3-44ad-8b1c-a3690e88e7e4" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:20 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d1590570-da57-432b-bc5f-6f0c9712148e tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-quobyte-c9431089-77e3-44ad-8b1c-a3690e88e7e4" acquired by "delete_volume" :: waited 0.022s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:20 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ee9a3f-f196-4db4-9270-574b029fe21f]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:13:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d1590570-da57-432b-bc5f-6f0c9712148e tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9431089-77e3-44ad-8b1c-a3690e88e7e4 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:20 devstack sudo[93887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9431089-77e3-44ad-8b1c-a3690e88e7e4 Jul 10 18:13:20 devstack sudo[93887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:21 devstack sudo[93885]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980" returned: 0 in 0.650s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:21 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:13:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-6d91a156-c636-422e-b1d1-4c219e6b0cc7 req-2e15e8ab-0dac-4941-94ff-732a089f0582 tempest-AttachVolumeTestJSON-309313673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.201s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:21 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e96e32e9-005d-4124-a6a8-e131bf2e6f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a41d35c-59d5-468b-bb2e-921439713980', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:21 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856fc1ee-936a-431a-9a09-4df9e60a61af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:21 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f31f64-2914-4049-b1f1-4ec681076837]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:13:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-6d91a156-c636-422e-b1d1-4c219e6b0cc7 req-2e15e8ab-0dac-4941-94ff-732a089f0582 tempest-AttachVolumeTestJSON-309313673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-cbd606b2-9c33-4116-83f5-6968474061b8 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:21 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] Volume volume-8a41d35c-59d5-468b-bb2e-921439713980 (8a41d35c-59d5-468b-bb2e-921439713980): created successfully Jul 10 18:13:21 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856fc1ee-936a-431a-9a09-4df9e60a61af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:21 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] Flow 'volume_create_manager' (13fcdc8e-438e-4917-9c33-a1350c919379) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:13:21 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-91d880ed-3f0b-48ce-9505-bd8f1a5bf7c3 tempest-SnapshotsActionsTest-446278604 None] Created volume successfully. Jul 10 18:13:21 devstack sudo[93890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-cbd606b2-9c33-4116-83f5-6968474061b8 Jul 10 18:13:21 devstack sudo[93890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:21 devstack sudo[93887]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d1590570-da57-432b-bc5f-6f0c9712148e tempest-VolumesSnapshotTestJSON-907745065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9431089-77e3-44ad-8b1c-a3690e88e7e4" returned: 0 in 0.788s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d1590570-da57-432b-bc5f-6f0c9712148e tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9431089-77e3-44ad-8b1c-a3690e88e7e4 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:21 devstack sudo[93896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9431089-77e3-44ad-8b1c-a3690e88e7e4 Jul 10 18:13:21 devstack sudo[93896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:21 devstack sudo[93890]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-6d91a156-c636-422e-b1d1-4c219e6b0cc7 req-2e15e8ab-0dac-4941-94ff-732a089f0582 tempest-AttachVolumeTestJSON-309313673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-cbd606b2-9c33-4116-83f5-6968474061b8" returned: 0 in 0.813s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-6d91a156-c636-422e-b1d1-4c219e6b0cc7 req-2e15e8ab-0dac-4941-94ff-732a089f0582 tempest-AttachVolumeTestJSON-309313673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.853s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.494s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:21 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:13:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1643379052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba03ca1a-63e5-4c9d-b346-3ff16672ceaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9bd296b8f834c89aa8abaafebe49877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:13:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:13:16Z,use_quota=True,user_id='942029a3e59a452e8c06b57e0b54fcab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:13:21 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] Creating volume ba03ca1a-63e5-4c9d-b346-3ff16672ceaf {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:13:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:21 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:13:21 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:13:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:21 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:13:21 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:13:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba03ca1a-63e5-4c9d-b346-3ff16672ceaf 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:22 devstack sudo[93902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba03ca1a-63e5-4c9d-b346-3ff16672ceaf 1073741824 Jul 10 18:13:22 devstack sudo[93902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:22 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-6d91a156-c636-422e-b1d1-4c219e6b0cc7 req-2e15e8ab-0dac-4941-94ff-732a089f0582 tempest-AttachVolumeTestJSON-309313673 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd', 'name': 'volume-cbd606b2-9c33-4116-83f5-6968474061b8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9d624165-5b2f-4a1d-93bc-3a84910970d5', 'enforce_multipath': True} {{(pid=87399) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 18:13:22 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-6d91a156-c636-422e-b1d1-4c219e6b0cc7 req-2e15e8ab-0dac-4941-94ff-732a089f0582 tempest-AttachVolumeTestJSON-309313673 None] attachment_update completed successfully. Jul 10 18:13:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f8bb257e-967d-4547-8b7e-371c4653a94b tempest-SnapshotsActionsTest-446278604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:22 devstack sudo[93896]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d1590570-da57-432b-bc5f-6f0c9712148e tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9431089-77e3-44ad-8b1c-a3690e88e7e4" returned: 0 in 0.747s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:22 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d1590570-da57-432b-bc5f-6f0c9712148e tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-quobyte-c9431089-77e3-44ad-8b1c-a3690e88e7e4" released by "delete_volume" :: held 1.582s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:22 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-d1590570-da57-432b-bc5f-6f0c9712148e tempest-VolumesSnapshotTestJSON-907745065 None] Created reservations ['d2e2fd62-7009-41fa-8407-97a8d95ae581', '8a9c39dc-f627-4432-ab86-d932bf068bc0', '85fd9691-bd4e-4bd3-95db-dbe78efd5787', 'f2989e35-5095-44e3-b9fa-b48de5c62bc5'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:13:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d1590570-da57-432b-bc5f-6f0c9712148e tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d1590570-da57-432b-bc5f-6f0c9712148e tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:22 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d1590570-da57-432b-bc5f-6f0c9712148e tempest-VolumesSnapshotTestJSON-907745065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:13:22 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d1590570-da57-432b-bc5f-6f0c9712148e tempest-VolumesSnapshotTestJSON-907745065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:13:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d1590570-da57-432b-bc5f-6f0c9712148e tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d1590570-da57-432b-bc5f-6f0c9712148e tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:22 devstack sudo[93951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:13:22 devstack sudo[93951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:22 devstack sudo[93902]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba03ca1a-63e5-4c9d-b346-3ff16672ceaf 1073741824" returned: 0 in 1.001s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba03ca1a-63e5-4c9d-b346-3ff16672ceaf {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:23 devstack sudo[93979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba03ca1a-63e5-4c9d-b346-3ff16672ceaf Jul 10 18:13:23 devstack sudo[93979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:23 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-43e58268-78a3-4f31-b545-2bafd661b49f tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "cinder-f8afbed0-2286-4d5e-8fa6-7b4cac6465b4-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:23 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-43e58268-78a3-4f31-b545-2bafd661b49f tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-f8afbed0-2286-4d5e-8fa6-7b4cac6465b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:23 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-43e58268-78a3-4f31-b545-2bafd661b49f tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "cinder-quobyte-8e66a96a-2099-4108-9db4-9cd21fd66c21" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:23 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-43e58268-78a3-4f31-b545-2bafd661b49f tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-quobyte-8e66a96a-2099-4108-9db4-9cd21fd66c21" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:23 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-43e58268-78a3-4f31-b545-2bafd661b49f tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "cinder-quobyte-f8afbed0-2286-4d5e-8fa6-7b4cac6465b4" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:23 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-43e58268-78a3-4f31-b545-2bafd661b49f tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-quobyte-f8afbed0-2286-4d5e-8fa6-7b4cac6465b4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:23 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-43e58268-78a3-4f31-b545-2bafd661b49f tempest-VolumesSnapshotTestJSON-907745065 None] Deleting offline snapshot f8afbed0-2286-4d5e-8fa6-7b4cac6465b4 of volume 8e66a96a-2099-4108-9db4-9cd21fd66c21 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:13:23 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-43e58268-78a3-4f31-b545-2bafd661b49f tempest-VolumesSnapshotTestJSON-907745065 None] snapshot_file for this snap is: volume-8e66a96a-2099-4108-9db4-9cd21fd66c21.f8afbed0-2286-4d5e-8fa6-7b4cac6465b4 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:13:23 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[91051853-ee84-4baf-bb45-73d1691b819d]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:13:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-43e58268-78a3-4f31-b545-2bafd661b49f tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21.f8afbed0-2286-4d5e-8fa6-7b4cac6465b4 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:23 devstack sudo[93982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21.f8afbed0-2286-4d5e-8fa6-7b4cac6465b4 Jul 10 18:13:23 devstack sudo[93982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:23 devstack sudo[93951]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d1590570-da57-432b-bc5f-6f0c9712148e tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.764s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:23 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-d1590570-da57-432b-bc5f-6f0c9712148e tempest-VolumesSnapshotTestJSON-907745065 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:13:23 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-d1590570-da57-432b-bc5f-6f0c9712148e tempest-VolumesSnapshotTestJSON-907745065 None] Deleted volume successfully. Jul 10 18:13:23 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d1590570-da57-432b-bc5f-6f0c9712148e tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-c9431089-77e3-44ad-8b1c-a3690e88e7e4-delete_volume" released by "delete_volume" :: held 2.610s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:23 devstack sudo[93979]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba03ca1a-63e5-4c9d-b346-3ff16672ceaf" returned: 0 in 0.859s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:23 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] <== create_volume: return (1909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:13:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.913s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f8bb257e-967d-4547-8b7e-371c4653a94b tempest-SnapshotsActionsTest-446278604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.716s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:23 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-f8bb257e-967d-4547-8b7e-371c4653a94b tempest-SnapshotsActionsTest-446278604 None] Creating offline snapshot 5b1159b9-3736-4acf-9c3e-37a7b417ac41 of volume 8a41d35c-59d5-468b-bb2e-921439713980 {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:13:23 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c21af4-340a-4801-867c-17293f4a6ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba03ca1a-63e5-4c9d-b346-3ff16672ceaf', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:23 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc88948-da29-47ed-aec2-f72c431a38f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:23 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f3c8ff-f59f-4fd0-9c70-2741acb0fc54]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:13:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f8bb257e-967d-4547-8b7e-371c4653a94b tempest-SnapshotsActionsTest-446278604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:23 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] Volume volume-ba03ca1a-63e5-4c9d-b346-3ff16672ceaf (ba03ca1a-63e5-4c9d-b346-3ff16672ceaf): created successfully Jul 10 18:13:23 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc88948-da29-47ed-aec2-f72c431a38f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:23 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] Flow 'volume_create_manager' (74bcd2da-2be9-46df-8202-be5f48070f2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:13:23 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-b7f042b7-d850-4cac-b321-c7d0417b4258 tempest-VolumesActionsTest-1492668241 None] Created volume successfully. Jul 10 18:13:24 devstack sudo[94311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980 Jul 10 18:13:24 devstack sudo[94311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:24 devstack sudo[93982]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-43e58268-78a3-4f31-b545-2bafd661b49f tempest-VolumesSnapshotTestJSON-907745065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21.f8afbed0-2286-4d5e-8fa6-7b4cac6465b4" returned: 0 in 0.894s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-43e58268-78a3-4f31-b545-2bafd661b49f tempest-VolumesSnapshotTestJSON-907745065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e66a96a-2099-4108-9db4-9cd21fd66c21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:13:24 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[244faa0c-38bf-458c-9899-419a7881be3f]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:13:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-43e58268-78a3-4f31-b545-2bafd661b49f tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:24 devstack sudo[94314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21 Jul 10 18:13:24 devstack sudo[94314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:24 devstack sudo[94311]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f8bb257e-967d-4547-8b7e-371c4653a94b tempest-SnapshotsActionsTest-446278604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980" returned: 0 in 0.842s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f8bb257e-967d-4547-8b7e-371c4653a94b tempest-SnapshotsActionsTest-446278604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:24 devstack sudo[94320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 1G Jul 10 18:13:24 devstack sudo[94320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:24 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-39b46830-60b7-4845-ad65-0e8d02ffcf63 tempest-VolumesActionsTest-1279522215 None] Acquiring lock "cinder-ba03ca1a-63e5-4c9d-b346-3ff16672ceaf-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:24 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-39b46830-60b7-4845-ad65-0e8d02ffcf63 tempest-VolumesActionsTest-1279522215 None] Lock "cinder-ba03ca1a-63e5-4c9d-b346-3ff16672ceaf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:24 devstack sudo[94314]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-43e58268-78a3-4f31-b545-2bafd661b49f tempest-VolumesSnapshotTestJSON-907745065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21" returned: 0 in 0.868s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-43e58268-78a3-4f31-b545-2bafd661b49f tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21.f8afbed0-2286-4d5e-8fa6-7b4cac6465b4 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:24 devstack sudo[94324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21.f8afbed0-2286-4d5e-8fa6-7b4cac6465b4 Jul 10 18:13:24 devstack sudo[94324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:25 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-39b46830-60b7-4845-ad65-0e8d02ffcf63 tempest-VolumesActionsTest-1279522215 None] Acquiring lock "cinder-quobyte-ba03ca1a-63e5-4c9d-b346-3ff16672ceaf" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:25 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-39b46830-60b7-4845-ad65-0e8d02ffcf63 tempest-VolumesActionsTest-1279522215 None] Lock "cinder-quobyte-ba03ca1a-63e5-4c9d-b346-3ff16672ceaf" acquired by "delete_volume" :: waited 0.020s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:25 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[913229ff-bfd6-40bb-a85a-8d598a89b00a]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:13:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-39b46830-60b7-4845-ad65-0e8d02ffcf63 tempest-VolumesActionsTest-1279522215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba03ca1a-63e5-4c9d-b346-3ff16672ceaf {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:25 devstack sudo[94326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba03ca1a-63e5-4c9d-b346-3ff16672ceaf Jul 10 18:13:25 devstack sudo[94326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:25 devstack sudo[94320]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f8bb257e-967d-4547-8b7e-371c4653a94b tempest-SnapshotsActionsTest-446278604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 1G" returned: 0 in 0.938s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f8bb257e-967d-4547-8b7e-371c4653a94b tempest-SnapshotsActionsTest-446278604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a41d35c-59d5-468b-bb2e-921439713980 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:25 devstack sudo[94337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a41d35c-59d5-468b-bb2e-921439713980 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 Jul 10 18:13:25 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:25 devstack sudo[94324]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-43e58268-78a3-4f31-b545-2bafd661b49f tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21.f8afbed0-2286-4d5e-8fa6-7b4cac6465b4" returned: 0 in 0.806s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-43e58268-78a3-4f31-b545-2bafd661b49f tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21.f8afbed0-2286-4d5e-8fa6-7b4cac6465b4 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:25 devstack sudo[94342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21.f8afbed0-2286-4d5e-8fa6-7b4cac6465b4 Jul 10 18:13:25 devstack sudo[94342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:25 devstack sudo[94326]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-39b46830-60b7-4845-ad65-0e8d02ffcf63 tempest-VolumesActionsTest-1279522215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba03ca1a-63e5-4c9d-b346-3ff16672ceaf" returned: 0 in 0.844s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-39b46830-60b7-4845-ad65-0e8d02ffcf63 tempest-VolumesActionsTest-1279522215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba03ca1a-63e5-4c9d-b346-3ff16672ceaf {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:25 devstack sudo[94344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba03ca1a-63e5-4c9d-b346-3ff16672ceaf Jul 10 18:13:25 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:26 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f8bb257e-967d-4547-8b7e-371c4653a94b tempest-SnapshotsActionsTest-446278604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a41d35c-59d5-468b-bb2e-921439713980 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41" returned: 0 in 0.751s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:26 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-f8bb257e-967d-4547-8b7e-371c4653a94b tempest-SnapshotsActionsTest-446278604 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 is being set with open permissions: ugo+rw Jul 10 18:13:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f8bb257e-967d-4547-8b7e-371c4653a94b tempest-SnapshotsActionsTest-446278604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:26 devstack sudo[94350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 Jul 10 18:13:26 devstack sudo[94350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:26 devstack sudo[94342]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-43e58268-78a3-4f31-b545-2bafd661b49f tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21.f8afbed0-2286-4d5e-8fa6-7b4cac6465b4" returned: 0 in 0.772s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:26 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-43e58268-78a3-4f31-b545-2bafd661b49f tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-quobyte-f8afbed0-2286-4d5e-8fa6-7b4cac6465b4" released by "_delete_snapshot" :: held 3.452s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:26 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-43e58268-78a3-4f31-b545-2bafd661b49f tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-quobyte-8e66a96a-2099-4108-9db4-9cd21fd66c21" released by "delete_snapshot" :: held 3.480s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:26 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-39b46830-60b7-4845-ad65-0e8d02ffcf63 tempest-VolumesActionsTest-1279522215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba03ca1a-63e5-4c9d-b346-3ff16672ceaf" returned: 0 in 0.703s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:26 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-39b46830-60b7-4845-ad65-0e8d02ffcf63 tempest-VolumesActionsTest-1279522215 None] Lock "cinder-quobyte-ba03ca1a-63e5-4c9d-b346-3ff16672ceaf" released by "delete_volume" :: held 1.596s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:26 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-43e58268-78a3-4f31-b545-2bafd661b49f tempest-VolumesSnapshotTestJSON-907745065 None] Created reservations ['4b3e64c7-d96a-423a-936f-506ee21ddf1f', '3fe678b1-56d5-40f4-a592-c6e4af35ab29', '9700121d-f47a-445e-8064-6bacb42e5978', 'd5530ee1-8226-4a98-8d9d-4b8a4c9e6b50'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:13:26 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-39b46830-60b7-4845-ad65-0e8d02ffcf63 tempest-VolumesActionsTest-1279522215 None] Created reservations ['45ece154-c5f8-490e-8c2c-e4147d0fd148', 'a8d280da-fbd9-4e4b-aa25-a1866cceea64', '5b9ea127-5cc5-485f-b846-06dea0c5681e', '82ab996b-26f9-45ed-9001-1b99859df6a7'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:13:26 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-43e58268-78a3-4f31-b545-2bafd661b49f tempest-VolumesSnapshotTestJSON-907745065 None] Delete snapshot completed successfully. Jul 10 18:13:26 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-43e58268-78a3-4f31-b545-2bafd661b49f tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-f8afbed0-2286-4d5e-8fa6-7b4cac6465b4-delete_snapshot" released by "delete_snapshot" :: held 3.680s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-39b46830-60b7-4845-ad65-0e8d02ffcf63 tempest-VolumesActionsTest-1279522215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-39b46830-60b7-4845-ad65-0e8d02ffcf63 tempest-VolumesActionsTest-1279522215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:26 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-39b46830-60b7-4845-ad65-0e8d02ffcf63 tempest-VolumesActionsTest-1279522215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:13:26 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-39b46830-60b7-4845-ad65-0e8d02ffcf63 tempest-VolumesActionsTest-1279522215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:13:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-39b46830-60b7-4845-ad65-0e8d02ffcf63 tempest-VolumesActionsTest-1279522215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-39b46830-60b7-4845-ad65-0e8d02ffcf63 tempest-VolumesActionsTest-1279522215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:26 devstack sudo[94353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:13:26 devstack sudo[94353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:27 devstack sudo[94350]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f8bb257e-967d-4547-8b7e-371c4653a94b tempest-SnapshotsActionsTest-446278604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41" returned: 0 in 0.742s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f8bb257e-967d-4547-8b7e-371c4653a94b tempest-SnapshotsActionsTest-446278604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:27 devstack sudo[94359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.info Jul 10 18:13:27 devstack sudo[94359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:27 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d00c1438-3f40-4c52-932b-d7ebbd75ead9 tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "cinder-8e66a96a-2099-4108-9db4-9cd21fd66c21-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:27 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d00c1438-3f40-4c52-932b-d7ebbd75ead9 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-8e66a96a-2099-4108-9db4-9cd21fd66c21-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:27 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d00c1438-3f40-4c52-932b-d7ebbd75ead9 tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "cinder-quobyte-8e66a96a-2099-4108-9db4-9cd21fd66c21" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:27 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d00c1438-3f40-4c52-932b-d7ebbd75ead9 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-quobyte-8e66a96a-2099-4108-9db4-9cd21fd66c21" acquired by "delete_volume" :: waited 0.019s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:27 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9adf12-dd03-489e-b343-4d460528213f]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:13:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d00c1438-3f40-4c52-932b-d7ebbd75ead9 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:27 devstack sudo[94353]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-39b46830-60b7-4845-ad65-0e8d02ffcf63 tempest-VolumesActionsTest-1279522215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.935s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:27 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-39b46830-60b7-4845-ad65-0e8d02ffcf63 tempest-VolumesActionsTest-1279522215 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:13:27 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-39b46830-60b7-4845-ad65-0e8d02ffcf63 tempest-VolumesActionsTest-1279522215 None] Deleted volume successfully. Jul 10 18:13:27 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-39b46830-60b7-4845-ad65-0e8d02ffcf63 tempest-VolumesActionsTest-1279522215 None] Lock "cinder-ba03ca1a-63e5-4c9d-b346-3ff16672ceaf-delete_volume" released by "delete_volume" :: held 2.843s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:27 devstack sudo[94362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21 Jul 10 18:13:27 devstack sudo[94362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:27 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:13:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] Flow 'volume_create_manager' (4849a984-4e85-4652-bed2-129c21334d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:13:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e174814b-1c61-444a-9e52-9ee371eb8006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e174814b-1c61-444a-9e52-9ee371eb8006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-795674079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7ded316-e6f2-4d13-8c96-7dbab631cc9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9bd296b8f834c89aa8abaafebe49877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:13:28Z,use_quota=True,user_id='942029a3e59a452e8c06b57e0b54fcab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f8888e0-221b-4844-858c-c9ce0cb4e0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f8888e0-221b-4844-858c-c9ce0cb4e0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed8c4a64-8c1b-4980-b274-a0aa2475a2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed8c4a64-8c1b-4980-b274-a0aa2475a2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7ded316-e6f2-4d13-8c96-7dbab631cc9c', 'volume_name': 'volume-e7ded316-e6f2-4d13-8c96-7dbab631cc9c', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b004395-9b90-4522-baac-430005927d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b004395-9b90-4522-baac-430005927d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8499d8c-0777-4e7b-9002-3e735e0ba6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:28 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] Volume e7ded316-e6f2-4d13-8c96-7dbab631cc9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7ded316-e6f2-4d13-8c96-7dbab631cc9c', 'volume_size': 1} Jul 10 18:13:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:28 devstack sudo[94359]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f8bb257e-967d-4547-8b7e-371c4653a94b tempest-SnapshotsActionsTest-446278604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.info" returned: 0 in 0.885s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:28 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-f8bb257e-967d-4547-8b7e-371c4653a94b tempest-SnapshotsActionsTest-446278604 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.info is being set with open permissions: ugo+rw Jul 10 18:13:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f8bb257e-967d-4547-8b7e-371c4653a94b tempest-SnapshotsActionsTest-446278604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:28 devstack sudo[94365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.info Jul 10 18:13:28 devstack sudo[94365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:28 devstack sudo[94362]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d00c1438-3f40-4c52-932b-d7ebbd75ead9 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21" returned: 0 in 0.900s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d00c1438-3f40-4c52-932b-d7ebbd75ead9 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:28 devstack sudo[94370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21 Jul 10 18:13:28 devstack sudo[94370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:28 devstack sudo[94365]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f8bb257e-967d-4547-8b7e-371c4653a94b tempest-SnapshotsActionsTest-446278604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.info" returned: 0 in 0.733s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f8bb257e-967d-4547-8b7e-371c4653a94b tempest-SnapshotsActionsTest-446278604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.996s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.834s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-795674079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7ded316-e6f2-4d13-8c96-7dbab631cc9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9bd296b8f834c89aa8abaafebe49877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:13:28Z,use_quota=True,user_id='942029a3e59a452e8c06b57e0b54fcab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:13:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] Creating volume e7ded316-e6f2-4d13-8c96-7dbab631cc9c {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:13:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:13:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:13:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:13:28 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:13:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e7ded316-e6f2-4d13-8c96-7dbab631cc9c 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:28 devstack sudo[94375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e7ded316-e6f2-4d13-8c96-7dbab631cc9c 1073741824 Jul 10 18:13:28 devstack sudo[94375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:28 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-f8bb257e-967d-4547-8b7e-371c4653a94b tempest-SnapshotsActionsTest-446278604 None] Create snapshot completed successfully Jul 10 18:13:29 devstack sudo[94370]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d00c1438-3f40-4c52-932b-d7ebbd75ead9 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e66a96a-2099-4108-9db4-9cd21fd66c21" returned: 0 in 0.730s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d00c1438-3f40-4c52-932b-d7ebbd75ead9 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-quobyte-8e66a96a-2099-4108-9db4-9cd21fd66c21" released by "delete_volume" :: held 1.701s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:29 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-d00c1438-3f40-4c52-932b-d7ebbd75ead9 tempest-VolumesSnapshotTestJSON-907745065 None] Created reservations ['2992de9b-e597-4de5-a38a-319ecfe4b337', 'bc190afe-366d-4392-a799-ec2bf7da08d1', 'f1b2ff52-1016-4a4b-bb79-445d30d6a37f', 'a2812f03-4688-4355-af42-b34cb3a0062d'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:13:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d00c1438-3f40-4c52-932b-d7ebbd75ead9 tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d00c1438-3f40-4c52-932b-d7ebbd75ead9 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d00c1438-3f40-4c52-932b-d7ebbd75ead9 tempest-VolumesSnapshotTestJSON-907745065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:13:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d00c1438-3f40-4c52-932b-d7ebbd75ead9 tempest-VolumesSnapshotTestJSON-907745065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:13:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d00c1438-3f40-4c52-932b-d7ebbd75ead9 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d00c1438-3f40-4c52-932b-d7ebbd75ead9 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:29 devstack sudo[94382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:13:29 devstack sudo[94382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-535b4bc8-e7a8-4276-a73c-fc2127cb6ef5 tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "cinder-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-535b4bc8-e7a8-4276-a73c-fc2127cb6ef5 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:30 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-535b4bc8-e7a8-4276-a73c-fc2127cb6ef5 tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "cinder-quobyte-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:30 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-535b4bc8-e7a8-4276-a73c-fc2127cb6ef5 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-quobyte-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0" acquired by "delete_volume" :: waited 0.029s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:30 devstack sudo[94375]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e7ded316-e6f2-4d13-8c96-7dbab631cc9c 1073741824" returned: 0 in 1.281s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:30 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[4412ea01-c2b2-4889-a4cc-cc313576406a]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:13:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-535b4bc8-e7a8-4276-a73c-fc2127cb6ef5 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e7ded316-e6f2-4d13-8c96-7dbab631cc9c {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:30 devstack sudo[94389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e7ded316-e6f2-4d13-8c96-7dbab631cc9c Jul 10 18:13:30 devstack sudo[94389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3d6c2a92-38d3-4a77-b094-31866c2971cb tempest-SnapshotsActionsTest-446278604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:30 devstack sudo[94388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0 Jul 10 18:13:30 devstack sudo[94388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:30 devstack sudo[94382]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d00c1438-3f40-4c52-932b-d7ebbd75ead9 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.272s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:30 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-d00c1438-3f40-4c52-932b-d7ebbd75ead9 tempest-VolumesSnapshotTestJSON-907745065 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:13:30 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-d00c1438-3f40-4c52-932b-d7ebbd75ead9 tempest-VolumesSnapshotTestJSON-907745065 None] Deleted volume successfully. Jul 10 18:13:30 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d00c1438-3f40-4c52-932b-d7ebbd75ead9 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-8e66a96a-2099-4108-9db4-9cd21fd66c21-delete_volume" released by "delete_volume" :: held 3.233s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:31 devstack sudo[94389]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e7ded316-e6f2-4d13-8c96-7dbab631cc9c" returned: 0 in 0.892s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:31 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] <== create_volume: return (2250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:13:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.253s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3d6c2a92-38d3-4a77-b094-31866c2971cb tempest-SnapshotsActionsTest-446278604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.803s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8499d8c-0777-4e7b-9002-3e735e0ba6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7ded316-e6f2-4d13-8c96-7dbab631cc9c', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab2c6d8-7af0-421c-8fdb-c1f67b39980b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:31 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-3d6c2a92-38d3-4a77-b094-31866c2971cb tempest-SnapshotsActionsTest-446278604 None] Creating offline snapshot 01ef15dd-44e5-4e4f-8950-fca80fe2fbdd of volume 8a41d35c-59d5-468b-bb2e-921439713980 {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:13:31 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] Volume volume-e7ded316-e6f2-4d13-8c96-7dbab631cc9c (e7ded316-e6f2-4d13-8c96-7dbab631cc9c): created successfully Jul 10 18:13:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ab2c6d8-7af0-421c-8fdb-c1f67b39980b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] Flow 'volume_create_manager' (4849a984-4e85-4652-bed2-129c21334d6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:13:31 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d0bca0-8062-4601-972f-a2cd2da39356]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:13:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3d6c2a92-38d3-4a77-b094-31866c2971cb tempest-SnapshotsActionsTest-446278604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:31 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-40df0984-e02a-44a8-8b8a-5a0cd9f9ac5c tempest-VolumesActionsTest-1492668241 None] Created volume successfully. Jul 10 18:13:31 devstack sudo[94399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 Jul 10 18:13:31 devstack sudo[94399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:31 devstack sudo[94388]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-535b4bc8-e7a8-4276-a73c-fc2127cb6ef5 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0" returned: 0 in 1.196s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-535b4bc8-e7a8-4276-a73c-fc2127cb6ef5 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:31 devstack sudo[94401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0 Jul 10 18:13:31 devstack sudo[94401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:32 devstack sudo[94399]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3d6c2a92-38d3-4a77-b094-31866c2971cb tempest-SnapshotsActionsTest-446278604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41" returned: 0 in 0.836s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-3d6c2a92-38d3-4a77-b094-31866c2971cb tempest-SnapshotsActionsTest-446278604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a41d35c-59d5-468b-bb2e-921439713980(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:13:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3d6c2a92-38d3-4a77-b094-31866c2971cb tempest-SnapshotsActionsTest-446278604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.01ef15dd-44e5-4e4f-8950-fca80fe2fbdd 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:32 devstack sudo[94408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.01ef15dd-44e5-4e4f-8950-fca80fe2fbdd 1G Jul 10 18:13:32 devstack sudo[94408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:32 devstack sudo[94401]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-535b4bc8-e7a8-4276-a73c-fc2127cb6ef5 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0" returned: 0 in 0.774s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:32 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-535b4bc8-e7a8-4276-a73c-fc2127cb6ef5 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-quobyte-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0" released by "delete_volume" :: held 2.102s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:32 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-535b4bc8-e7a8-4276-a73c-fc2127cb6ef5 tempest-VolumesSnapshotTestJSON-907745065 None] Created reservations ['5b6f2c55-954e-407b-9836-28f370255a2a', 'abe87c79-76a9-4457-8ff1-ad8f2e33ea26', '0fce7794-90c4-46cc-ac19-f572dba5e49c', '7b2db622-4626-4ec9-8f8a-83f4ff1abc07'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:13:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-535b4bc8-e7a8-4276-a73c-fc2127cb6ef5 tempest-VolumesSnapshotTestJSON-907745065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-535b4bc8-e7a8-4276-a73c-fc2127cb6ef5 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-535b4bc8-e7a8-4276-a73c-fc2127cb6ef5 tempest-VolumesSnapshotTestJSON-907745065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:13:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-535b4bc8-e7a8-4276-a73c-fc2127cb6ef5 tempest-VolumesSnapshotTestJSON-907745065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:13:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-535b4bc8-e7a8-4276-a73c-fc2127cb6ef5 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-535b4bc8-e7a8-4276-a73c-fc2127cb6ef5 tempest-VolumesSnapshotTestJSON-907745065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:32 devstack sudo[94410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:13:32 devstack sudo[94410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:32 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-716a7461-d745-4fba-bbd6-d1a13345fa10 tempest-VolumesActionsTest-1279522215 None] Acquiring lock "cinder-e7ded316-e6f2-4d13-8c96-7dbab631cc9c-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:32 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-716a7461-d745-4fba-bbd6-d1a13345fa10 tempest-VolumesActionsTest-1279522215 None] Lock "cinder-e7ded316-e6f2-4d13-8c96-7dbab631cc9c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:32 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-716a7461-d745-4fba-bbd6-d1a13345fa10 tempest-VolumesActionsTest-1279522215 None] Acquiring lock "cinder-quobyte-e7ded316-e6f2-4d13-8c96-7dbab631cc9c" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:32 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-716a7461-d745-4fba-bbd6-d1a13345fa10 tempest-VolumesActionsTest-1279522215 None] Lock "cinder-quobyte-e7ded316-e6f2-4d13-8c96-7dbab631cc9c" acquired by "delete_volume" :: waited 0.019s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:32 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[f881ea2f-1fb4-4cfa-b3fd-8fdac76e4efe]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:13:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-716a7461-d745-4fba-bbd6-d1a13345fa10 tempest-VolumesActionsTest-1279522215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e7ded316-e6f2-4d13-8c96-7dbab631cc9c {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:32 devstack sudo[94416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e7ded316-e6f2-4d13-8c96-7dbab631cc9c Jul 10 18:13:32 devstack sudo[94416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:33 devstack sudo[94408]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3d6c2a92-38d3-4a77-b094-31866c2971cb tempest-SnapshotsActionsTest-446278604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.01ef15dd-44e5-4e4f-8950-fca80fe2fbdd 1G" returned: 0 in 0.994s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3d6c2a92-38d3-4a77-b094-31866c2971cb tempest-SnapshotsActionsTest-446278604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.01ef15dd-44e5-4e4f-8950-fca80fe2fbdd {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:33 devstack sudo[94419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.01ef15dd-44e5-4e4f-8950-fca80fe2fbdd Jul 10 18:13:33 devstack sudo[94419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:33 devstack sudo[94410]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-535b4bc8-e7a8-4276-a73c-fc2127cb6ef5 tempest-VolumesSnapshotTestJSON-907745065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.878s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:33 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-535b4bc8-e7a8-4276-a73c-fc2127cb6ef5 tempest-VolumesSnapshotTestJSON-907745065 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:13:33 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-535b4bc8-e7a8-4276-a73c-fc2127cb6ef5 tempest-VolumesSnapshotTestJSON-907745065 None] Deleted volume successfully. Jul 10 18:13:33 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-535b4bc8-e7a8-4276-a73c-fc2127cb6ef5 tempest-VolumesSnapshotTestJSON-907745065 None] Lock "cinder-9d0eb0ed-35e9-41e0-8f43-ccad3a8c96f0-delete_volume" released by "delete_volume" :: held 3.346s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:33 devstack sudo[94416]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-716a7461-d745-4fba-bbd6-d1a13345fa10 tempest-VolumesActionsTest-1279522215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e7ded316-e6f2-4d13-8c96-7dbab631cc9c" returned: 0 in 0.901s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-716a7461-d745-4fba-bbd6-d1a13345fa10 tempest-VolumesActionsTest-1279522215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e7ded316-e6f2-4d13-8c96-7dbab631cc9c {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:33 devstack sudo[94424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e7ded316-e6f2-4d13-8c96-7dbab631cc9c Jul 10 18:13:33 devstack sudo[94424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:33 devstack sudo[94419]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3d6c2a92-38d3-4a77-b094-31866c2971cb tempest-SnapshotsActionsTest-446278604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.01ef15dd-44e5-4e4f-8950-fca80fe2fbdd" returned: 0 in 0.899s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:34 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-3d6c2a92-38d3-4a77-b094-31866c2971cb tempest-SnapshotsActionsTest-446278604 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.01ef15dd-44e5-4e4f-8950-fca80fe2fbdd is being set with open permissions: ugo+rw Jul 10 18:13:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3d6c2a92-38d3-4a77-b094-31866c2971cb tempest-SnapshotsActionsTest-446278604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.01ef15dd-44e5-4e4f-8950-fca80fe2fbdd {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:34 devstack sudo[94429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.01ef15dd-44e5-4e4f-8950-fca80fe2fbdd Jul 10 18:13:34 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:34 devstack sudo[94424]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-716a7461-d745-4fba-bbd6-d1a13345fa10 tempest-VolumesActionsTest-1279522215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e7ded316-e6f2-4d13-8c96-7dbab631cc9c" returned: 0 in 0.767s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:34 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-716a7461-d745-4fba-bbd6-d1a13345fa10 tempest-VolumesActionsTest-1279522215 None] Lock "cinder-quobyte-e7ded316-e6f2-4d13-8c96-7dbab631cc9c" released by "delete_volume" :: held 1.725s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:34 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-716a7461-d745-4fba-bbd6-d1a13345fa10 tempest-VolumesActionsTest-1279522215 None] Created reservations ['a11ba05e-c3f2-4d37-8e58-d1284a0a534e', '5d31d0f3-61c1-4731-b8c0-a03291dd334b', '33f57d02-374c-4b6a-b79d-9eb8a52b754f', 'e3663890-5aa2-4205-953c-035effe872bb'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:13:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-716a7461-d745-4fba-bbd6-d1a13345fa10 tempest-VolumesActionsTest-1279522215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-716a7461-d745-4fba-bbd6-d1a13345fa10 tempest-VolumesActionsTest-1279522215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:34 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-716a7461-d745-4fba-bbd6-d1a13345fa10 tempest-VolumesActionsTest-1279522215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:13:34 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-716a7461-d745-4fba-bbd6-d1a13345fa10 tempest-VolumesActionsTest-1279522215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:13:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-716a7461-d745-4fba-bbd6-d1a13345fa10 tempest-VolumesActionsTest-1279522215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-716a7461-d745-4fba-bbd6-d1a13345fa10 tempest-VolumesActionsTest-1279522215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:34 devstack sudo[94434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:13:34 devstack sudo[94434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:34 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3d6c2a92-38d3-4a77-b094-31866c2971cb tempest-SnapshotsActionsTest-446278604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.01ef15dd-44e5-4e4f-8950-fca80fe2fbdd" returned: 0 in 0.787s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3d6c2a92-38d3-4a77-b094-31866c2971cb tempest-SnapshotsActionsTest-446278604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.703s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:34 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-3d6c2a92-38d3-4a77-b094-31866c2971cb tempest-SnapshotsActionsTest-446278604 None] Create snapshot completed successfully Jul 10 18:13:35 devstack sudo[94434]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-716a7461-d745-4fba-bbd6-d1a13345fa10 tempest-VolumesActionsTest-1279522215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.806s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-716a7461-d745-4fba-bbd6-d1a13345fa10 tempest-VolumesActionsTest-1279522215 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:13:35 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-716a7461-d745-4fba-bbd6-d1a13345fa10 tempest-VolumesActionsTest-1279522215 None] Deleted volume successfully. Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] Flow 'volume_create_manager' (3b21076d-eb30-4876-b0da-029c4d7cd056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9f4e391-d6f3-4d5f-ac51-2bda2d89ae27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9f4e391-d6f3-4d5f-ac51-2bda2d89ae27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-455328972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3441ffc5-eb82-4c78-a64e-db5ebb7f8711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9bd296b8f834c89aa8abaafebe49877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:13:35Z,use_quota=True,user_id='942029a3e59a452e8c06b57e0b54fcab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ada71a-50f7-43af-a7f4-40a472278760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ada71a-50f7-43af-a7f4-40a472278760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d541f264-8023-4f8c-8931-c3f978565b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d541f264-8023-4f8c-8931-c3f978565b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3441ffc5-eb82-4c78-a64e-db5ebb7f8711', 'volume_name': 'volume-3441ffc5-eb82-4c78-a64e-db5ebb7f8711', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (105a69ff-4295-46ed-9be0-8cda6bdad36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (105a69ff-4295-46ed-9be0-8cda6bdad36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e28e0d-f270-484c-b3f1-a62dd8722fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:35 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] Volume 3441ffc5-eb82-4c78-a64e-db5ebb7f8711: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3441ffc5-eb82-4c78-a64e-db5ebb7f8711', 'volume_size': 1} Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-455328972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3441ffc5-eb82-4c78-a64e-db5ebb7f8711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9bd296b8f834c89aa8abaafebe49877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:13:35Z,use_quota=True,user_id='942029a3e59a452e8c06b57e0b54fcab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] Creating volume 3441ffc5-eb82-4c78-a64e-db5ebb7f8711 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:13:35 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3441ffc5-eb82-4c78-a64e-db5ebb7f8711 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:35 devstack sudo[94440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3441ffc5-eb82-4c78-a64e-db5ebb7f8711 1073741824 Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-716a7461-d745-4fba-bbd6-d1a13345fa10 tempest-VolumesActionsTest-1279522215 None] Lock "cinder-e7ded316-e6f2-4d13-8c96-7dbab631cc9c-delete_volume" released by "delete_volume" :: held 2.935s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:35 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c86ec2a0-60c5-4bf9-a6aa-3106d29db1da tempest-SnapshotsActionsTest-180742597 None] Acquiring lock "cinder-01ef15dd-44e5-4e4f-8950-fca80fe2fbdd-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c86ec2a0-60c5-4bf9-a6aa-3106d29db1da tempest-SnapshotsActionsTest-180742597 None] Lock "cinder-01ef15dd-44e5-4e4f-8950-fca80fe2fbdd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c86ec2a0-60c5-4bf9-a6aa-3106d29db1da tempest-SnapshotsActionsTest-180742597 None] Acquiring lock "cinder-quobyte-8a41d35c-59d5-468b-bb2e-921439713980" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c86ec2a0-60c5-4bf9-a6aa-3106d29db1da tempest-SnapshotsActionsTest-180742597 None] Lock "cinder-quobyte-8a41d35c-59d5-468b-bb2e-921439713980" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c86ec2a0-60c5-4bf9-a6aa-3106d29db1da tempest-SnapshotsActionsTest-180742597 None] Acquiring lock "cinder-quobyte-01ef15dd-44e5-4e4f-8950-fca80fe2fbdd" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c86ec2a0-60c5-4bf9-a6aa-3106d29db1da tempest-SnapshotsActionsTest-180742597 None] Lock "cinder-quobyte-01ef15dd-44e5-4e4f-8950-fca80fe2fbdd" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-c86ec2a0-60c5-4bf9-a6aa-3106d29db1da tempest-SnapshotsActionsTest-180742597 None] Deleting offline snapshot 01ef15dd-44e5-4e4f-8950-fca80fe2fbdd of volume 8a41d35c-59d5-468b-bb2e-921439713980 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-c86ec2a0-60c5-4bf9-a6aa-3106d29db1da tempest-SnapshotsActionsTest-180742597 None] snapshot_file for this snap is: volume-8a41d35c-59d5-468b-bb2e-921439713980.01ef15dd-44e5-4e4f-8950-fca80fe2fbdd {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[361afc46-44f7-4bd6-afb2-8f879bba9c70]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:13:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c86ec2a0-60c5-4bf9-a6aa-3106d29db1da tempest-SnapshotsActionsTest-180742597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.01ef15dd-44e5-4e4f-8950-fca80fe2fbdd {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:36 devstack sudo[94478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.01ef15dd-44e5-4e4f-8950-fca80fe2fbdd Jul 10 18:13:36 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:36 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3441ffc5-eb82-4c78-a64e-db5ebb7f8711 1073741824" returned: 0 in 1.371s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3441ffc5-eb82-4c78-a64e-db5ebb7f8711 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:37 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c86ec2a0-60c5-4bf9-a6aa-3106d29db1da tempest-SnapshotsActionsTest-180742597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.01ef15dd-44e5-4e4f-8950-fca80fe2fbdd" returned: 0 in 1.084s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:37 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-c86ec2a0-60c5-4bf9-a6aa-3106d29db1da tempest-SnapshotsActionsTest-180742597 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a41d35c-59d5-468b-bb2e-921439713980(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:13:37 devstack sudo[94558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3441ffc5-eb82-4c78-a64e-db5ebb7f8711 Jul 10 18:13:37 devstack sudo[94558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:37 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[f437e0ff-9233-440f-a7e1-70440edace27]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:13:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c86ec2a0-60c5-4bf9-a6aa-3106d29db1da tempest-SnapshotsActionsTest-180742597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:37 devstack sudo[94561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 Jul 10 18:13:37 devstack sudo[94561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:37 devstack sudo[94558]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3441ffc5-eb82-4c78-a64e-db5ebb7f8711" returned: 0 in 0.748s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:37 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] <== create_volume: return (2178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:13:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.181s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e28e0d-f270-484c-b3f1-a62dd8722fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3441ffc5-eb82-4c78-a64e-db5ebb7f8711', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ff070d-2a74-406f-8ed6-b498b6e22700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:37 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] Volume volume-3441ffc5-eb82-4c78-a64e-db5ebb7f8711 (3441ffc5-eb82-4c78-a64e-db5ebb7f8711): created successfully Jul 10 18:13:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ff070d-2a74-406f-8ed6-b498b6e22700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] Flow 'volume_create_manager' (3b21076d-eb30-4876-b0da-029c4d7cd056) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:13:37 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-29f70d4f-26e3-44e6-a798-f5ec587be4a2 tempest-VolumesActionsTest-1492668241 None] Created volume successfully. Jul 10 18:13:38 devstack sudo[94561]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c86ec2a0-60c5-4bf9-a6aa-3106d29db1da tempest-SnapshotsActionsTest-180742597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41" returned: 0 in 0.933s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-c86ec2a0-60c5-4bf9-a6aa-3106d29db1da tempest-SnapshotsActionsTest-180742597 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a41d35c-59d5-468b-bb2e-921439713980(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:13:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c86ec2a0-60c5-4bf9-a6aa-3106d29db1da tempest-SnapshotsActionsTest-180742597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.01ef15dd-44e5-4e4f-8950-fca80fe2fbdd {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:38 devstack sudo[94569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.01ef15dd-44e5-4e4f-8950-fca80fe2fbdd Jul 10 18:13:38 devstack sudo[94569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:38 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-de76f49b-bce9-48eb-af15-973e043f0ed6 tempest-VolumesActionsTest-1279522215 None] Acquiring lock "cinder-3441ffc5-eb82-4c78-a64e-db5ebb7f8711-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:39 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-de76f49b-bce9-48eb-af15-973e043f0ed6 tempest-VolumesActionsTest-1279522215 None] Lock "cinder-3441ffc5-eb82-4c78-a64e-db5ebb7f8711-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:39 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-de76f49b-bce9-48eb-af15-973e043f0ed6 tempest-VolumesActionsTest-1279522215 None] Acquiring lock "cinder-quobyte-3441ffc5-eb82-4c78-a64e-db5ebb7f8711" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:39 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-de76f49b-bce9-48eb-af15-973e043f0ed6 tempest-VolumesActionsTest-1279522215 None] Lock "cinder-quobyte-3441ffc5-eb82-4c78-a64e-db5ebb7f8711" acquired by "delete_volume" :: waited 0.022s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:39 devstack sudo[94569]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c86ec2a0-60c5-4bf9-a6aa-3106d29db1da tempest-SnapshotsActionsTest-180742597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.01ef15dd-44e5-4e4f-8950-fca80fe2fbdd" returned: 0 in 1.084s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c86ec2a0-60c5-4bf9-a6aa-3106d29db1da tempest-SnapshotsActionsTest-180742597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.01ef15dd-44e5-4e4f-8950-fca80fe2fbdd {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:39 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[077d64d8-c957-4b98-bebb-8aab1d9e7f57]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:13:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-de76f49b-bce9-48eb-af15-973e043f0ed6 tempest-VolumesActionsTest-1279522215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3441ffc5-eb82-4c78-a64e-db5ebb7f8711 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:39 devstack sudo[94584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.01ef15dd-44e5-4e4f-8950-fca80fe2fbdd Jul 10 18:13:39 devstack sudo[94584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:39 devstack sudo[94585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3441ffc5-eb82-4c78-a64e-db5ebb7f8711 Jul 10 18:13:39 devstack sudo[94585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:40 devstack sudo[94584]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c86ec2a0-60c5-4bf9-a6aa-3106d29db1da tempest-SnapshotsActionsTest-180742597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.01ef15dd-44e5-4e4f-8950-fca80fe2fbdd" returned: 0 in 0.918s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:40 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c86ec2a0-60c5-4bf9-a6aa-3106d29db1da tempest-SnapshotsActionsTest-180742597 None] Lock "cinder-quobyte-01ef15dd-44e5-4e4f-8950-fca80fe2fbdd" released by "_delete_snapshot" :: held 4.271s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:40 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c86ec2a0-60c5-4bf9-a6aa-3106d29db1da tempest-SnapshotsActionsTest-180742597 None] Lock "cinder-quobyte-8a41d35c-59d5-468b-bb2e-921439713980" released by "delete_snapshot" :: held 4.337s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:40 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-c86ec2a0-60c5-4bf9-a6aa-3106d29db1da tempest-SnapshotsActionsTest-180742597 None] Created reservations ['a73754d5-b3c5-4025-92b3-72d3e2b58f0b', '6762f44f-2ee4-4840-890c-231feeeb6de4', '804903cb-ac17-4b70-98a7-a177888b8b7c', '3dd6723b-5dbd-4d8d-8e98-5918cd13ac90'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:13:40 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-c86ec2a0-60c5-4bf9-a6aa-3106d29db1da tempest-SnapshotsActionsTest-180742597 None] Delete snapshot completed successfully. Jul 10 18:13:40 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c86ec2a0-60c5-4bf9-a6aa-3106d29db1da tempest-SnapshotsActionsTest-180742597 None] Lock "cinder-01ef15dd-44e5-4e4f-8950-fca80fe2fbdd-delete_snapshot" released by "delete_snapshot" :: held 4.612s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:40 devstack sudo[94585]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-de76f49b-bce9-48eb-af15-973e043f0ed6 tempest-VolumesActionsTest-1279522215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3441ffc5-eb82-4c78-a64e-db5ebb7f8711" returned: 0 in 1.301s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-de76f49b-bce9-48eb-af15-973e043f0ed6 tempest-VolumesActionsTest-1279522215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3441ffc5-eb82-4c78-a64e-db5ebb7f8711 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:40 devstack sudo[94955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3441ffc5-eb82-4c78-a64e-db5ebb7f8711 Jul 10 18:13:40 devstack sudo[94955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:41 devstack sudo[94955]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-de76f49b-bce9-48eb-af15-973e043f0ed6 tempest-VolumesActionsTest-1279522215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3441ffc5-eb82-4c78-a64e-db5ebb7f8711" returned: 0 in 1.066s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:41 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-de76f49b-bce9-48eb-af15-973e043f0ed6 tempest-VolumesActionsTest-1279522215 None] Lock "cinder-quobyte-3441ffc5-eb82-4c78-a64e-db5ebb7f8711" released by "delete_volume" :: held 2.432s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:41 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:13:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Flow 'volume_create_manager' (5d4e6c9e-f2cb-428d-a701-8fe04e199949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:13:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd5e223-354d-464f-8d28-d91a4e156e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dd5e223-354d-464f-8d28-d91a4e156e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-799316944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95be9209-4c37-4f61-89b1-9c99283e9012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1114841c293485d9253da4f0f56679d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:13:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:13:41Z,use_quota=True,user_id='e184ff90c19d47548be303aa82476a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae28a95c-f941-4def-a9fd-2ad7388ceb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae28a95c-f941-4def-a9fd-2ad7388ceb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e57e2835-b19b-4c85-9df8-bc3a0141d258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e57e2835-b19b-4c85-9df8-bc3a0141d258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95be9209-4c37-4f61-89b1-9c99283e9012', 'volume_name': 'volume-95be9209-4c37-4f61-89b1-9c99283e9012', 'volume_size': 2}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28172cbc-8051-4cef-a7ec-26974bee99c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28172cbc-8051-4cef-a7ec-26974bee99c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed11bc18-dc48-4a39-b27d-f91131cc39cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:41 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Volume 95be9209-4c37-4f61-89b1-9c99283e9012: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95be9209-4c37-4f61-89b1-9c99283e9012', 'volume_size': 2} Jul 10 18:13:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:41 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:13:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-799316944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95be9209-4c37-4f61-89b1-9c99283e9012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1114841c293485d9253da4f0f56679d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:13:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:13:41Z,use_quota=True,user_id='e184ff90c19d47548be303aa82476a50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:13:41 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Creating volume 95be9209-4c37-4f61-89b1-9c99283e9012 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:13:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:41 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:13:41 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:13:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:41 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:13:41 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:13:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012 2147483648 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:41 devstack sudo[94978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012 2147483648 Jul 10 18:13:41 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-45051f28-98b1-4225-aaff-ea2e4501e041 tempest-SnapshotsActionsTest-446278604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:41 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-de76f49b-bce9-48eb-af15-973e043f0ed6 tempest-VolumesActionsTest-1279522215 None] Created reservations ['fe58f2b8-5b41-4129-9bff-986eae6b4107', 'eacedbfd-08de-407c-85ab-29a7306b9388', '683efd5b-8956-4665-a9a0-4f272a06004f', '6a2285fd-ec15-4059-bf11-0abb008d97fd'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:13:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-de76f49b-bce9-48eb-af15-973e043f0ed6 tempest-VolumesActionsTest-1279522215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-de76f49b-bce9-48eb-af15-973e043f0ed6 tempest-VolumesActionsTest-1279522215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:41 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-de76f49b-bce9-48eb-af15-973e043f0ed6 tempest-VolumesActionsTest-1279522215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:13:41 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-de76f49b-bce9-48eb-af15-973e043f0ed6 tempest-VolumesActionsTest-1279522215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:13:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-de76f49b-bce9-48eb-af15-973e043f0ed6 tempest-VolumesActionsTest-1279522215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-de76f49b-bce9-48eb-af15-973e043f0ed6 tempest-VolumesActionsTest-1279522215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:41 devstack sudo[94982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:13:41 devstack sudo[94982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:42 devstack sudo[94982]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-de76f49b-bce9-48eb-af15-973e043f0ed6 tempest-VolumesActionsTest-1279522215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.819s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:42 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-de76f49b-bce9-48eb-af15-973e043f0ed6 tempest-VolumesActionsTest-1279522215 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:13:42 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-de76f49b-bce9-48eb-af15-973e043f0ed6 tempest-VolumesActionsTest-1279522215 None] Deleted volume successfully. Jul 10 18:13:42 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-de76f49b-bce9-48eb-af15-973e043f0ed6 tempest-VolumesActionsTest-1279522215 None] Lock "cinder-3441ffc5-eb82-4c78-a64e-db5ebb7f8711-delete_volume" released by "delete_volume" :: held 3.750s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:42 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012 2147483648" returned: 0 in 1.303s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:43 devstack sudo[95023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012 Jul 10 18:13:43 devstack sudo[95023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:43 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:13:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] Flow 'volume_create_manager' (8641be12-a5ce-43ba-8666-ee597336419d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:13:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0139f80d-d27e-469c-9506-cebcec8ecd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0139f80d-d27e-469c-9506-cebcec8ecd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1256447766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5432dfe-9d6b-4e80-ad0d-bdcc28abbd85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9bd296b8f834c89aa8abaafebe49877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:13:43Z,use_quota=True,user_id='942029a3e59a452e8c06b57e0b54fcab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0206e115-ec26-40b2-984f-0a2317cea191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0206e115-ec26-40b2-984f-0a2317cea191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c2e90d-f639-475d-ac14-4f58f5b3fb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c2e90d-f639-475d-ac14-4f58f5b3fb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5432dfe-9d6b-4e80-ad0d-bdcc28abbd85', 'volume_name': 'volume-b5432dfe-9d6b-4e80-ad0d-bdcc28abbd85', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b9c0cf-b613-408d-8ba5-c23830a0da23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94b9c0cf-b613-408d-8ba5-c23830a0da23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d960317c-d614-4a2e-abec-20489db1fe6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:43 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] Volume b5432dfe-9d6b-4e80-ad0d-bdcc28abbd85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5432dfe-9d6b-4e80-ad0d-bdcc28abbd85', 'volume_size': 1} Jul 10 18:13:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:43 devstack sudo[95023]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012" returned: 0 in 0.873s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:43 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] <== create_volume: return (2243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:13:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.247s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-45051f28-98b1-4225-aaff-ea2e4501e041 tempest-SnapshotsActionsTest-446278604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.187s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:43 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-45051f28-98b1-4225-aaff-ea2e4501e041 tempest-SnapshotsActionsTest-446278604 None] Creating offline snapshot d8cc4475-8fc2-433e-a02d-fe1b32f77e72 of volume 8a41d35c-59d5-468b-bb2e-921439713980 {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:13:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed11bc18-dc48-4a39-b27d-f91131cc39cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95be9209-4c37-4f61-89b1-9c99283e9012', 'volume_size': 2}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b0c906-1611-40c8-b356-ecc890d7e09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:43 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e709896-f44f-4143-969f-b97f42993c4e]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:13:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-45051f28-98b1-4225-aaff-ea2e4501e041 tempest-SnapshotsActionsTest-446278604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:44 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Volume volume-95be9209-4c37-4f61-89b1-9c99283e9012 (95be9209-4c37-4f61-89b1-9c99283e9012): created successfully Jul 10 18:13:44 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b0c906-1611-40c8-b356-ecc890d7e09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:44 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Flow 'volume_create_manager' (5d4e6c9e-f2cb-428d-a701-8fe04e199949) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:13:44 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-0a52a99d-1d78-4c7b-909e-98f9496f913f tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Created volume successfully. Jul 10 18:13:44 devstack sudo[95028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 Jul 10 18:13:44 devstack sudo[95028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:44 devstack sudo[95028]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-45051f28-98b1-4225-aaff-ea2e4501e041 tempest-SnapshotsActionsTest-446278604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41" returned: 0 in 0.836s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:44 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-45051f28-98b1-4225-aaff-ea2e4501e041 tempest-SnapshotsActionsTest-446278604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a41d35c-59d5-468b-bb2e-921439713980(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:13:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-45051f28-98b1-4225-aaff-ea2e4501e041 tempest-SnapshotsActionsTest-446278604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.d8cc4475-8fc2-433e-a02d-fe1b32f77e72 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:44 devstack sudo[95034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.d8cc4475-8fc2-433e-a02d-fe1b32f77e72 1G Jul 10 18:13:44 devstack sudo[95034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-fce3e80e-83ae-4eae-bd85-1f47f5ad385c tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:45 devstack sudo[95034]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-45051f28-98b1-4225-aaff-ea2e4501e041 tempest-SnapshotsActionsTest-446278604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.d8cc4475-8fc2-433e-a02d-fe1b32f77e72 1G" returned: 0 in 0.851s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-45051f28-98b1-4225-aaff-ea2e4501e041 tempest-SnapshotsActionsTest-446278604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.d8cc4475-8fc2-433e-a02d-fe1b32f77e72 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:45 devstack sudo[95040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.d8cc4475-8fc2-433e-a02d-fe1b32f77e72 Jul 10 18:13:45 devstack sudo[95040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:46 devstack sudo[95040]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-45051f28-98b1-4225-aaff-ea2e4501e041 tempest-SnapshotsActionsTest-446278604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.d8cc4475-8fc2-433e-a02d-fe1b32f77e72" returned: 0 in 0.713s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:46 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-45051f28-98b1-4225-aaff-ea2e4501e041 tempest-SnapshotsActionsTest-446278604 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.d8cc4475-8fc2-433e-a02d-fe1b32f77e72 is being set with open permissions: ugo+rw Jul 10 18:13:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-45051f28-98b1-4225-aaff-ea2e4501e041 tempest-SnapshotsActionsTest-446278604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.d8cc4475-8fc2-433e-a02d-fe1b32f77e72 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:46 devstack sudo[95045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.d8cc4475-8fc2-433e-a02d-fe1b32f77e72 Jul 10 18:13:46 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:47 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-45051f28-98b1-4225-aaff-ea2e4501e041 tempest-SnapshotsActionsTest-446278604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.d8cc4475-8fc2-433e-a02d-fe1b32f77e72" returned: 0 in 0.684s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:47 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=132,cinder:UPDATE=133,cinder:DELETE=10,cinder:INSERT=39 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:13:47 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=119,cinder:UPDATE=159,cinder:INSERT=31,cinder:DELETE=12 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:13:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-45051f28-98b1-4225-aaff-ea2e4501e041 tempest-SnapshotsActionsTest-446278604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.204s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.480s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1256447766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5432dfe-9d6b-4e80-ad0d-bdcc28abbd85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9bd296b8f834c89aa8abaafebe49877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:13:43Z,use_quota=True,user_id='942029a3e59a452e8c06b57e0b54fcab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:13:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] Creating volume b5432dfe-9d6b-4e80-ad0d-bdcc28abbd85 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:13:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:13:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:13:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:13:47 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:13:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5432dfe-9d6b-4e80-ad0d-bdcc28abbd85 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:47 devstack sudo[95048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5432dfe-9d6b-4e80-ad0d-bdcc28abbd85 1073741824 Jul 10 18:13:47 devstack sudo[95048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:47 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-45051f28-98b1-4225-aaff-ea2e4501e041 tempest-SnapshotsActionsTest-446278604 None] Create snapshot completed successfully Jul 10 18:13:47 devstack sudo[95048]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5432dfe-9d6b-4e80-ad0d-bdcc28abbd85 1073741824" returned: 0 in 0.865s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4473e826-ce5a-4bd8-9d8b-c312708948d3 tempest-SnapshotsActionsTest-180742597 None] Acquiring lock "cinder-d8cc4475-8fc2-433e-a02d-fe1b32f77e72-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4473e826-ce5a-4bd8-9d8b-c312708948d3 tempest-SnapshotsActionsTest-180742597 None] Lock "cinder-d8cc4475-8fc2-433e-a02d-fe1b32f77e72-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4473e826-ce5a-4bd8-9d8b-c312708948d3 tempest-SnapshotsActionsTest-180742597 None] Acquiring lock "cinder-quobyte-8a41d35c-59d5-468b-bb2e-921439713980" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5432dfe-9d6b-4e80-ad0d-bdcc28abbd85 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4473e826-ce5a-4bd8-9d8b-c312708948d3 tempest-SnapshotsActionsTest-180742597 None] Lock "cinder-quobyte-8a41d35c-59d5-468b-bb2e-921439713980" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4473e826-ce5a-4bd8-9d8b-c312708948d3 tempest-SnapshotsActionsTest-180742597 None] Acquiring lock "cinder-quobyte-d8cc4475-8fc2-433e-a02d-fe1b32f77e72" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:48 devstack sudo[95054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5432dfe-9d6b-4e80-ad0d-bdcc28abbd85 Jul 10 18:13:48 devstack sudo[95054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4473e826-ce5a-4bd8-9d8b-c312708948d3 tempest-SnapshotsActionsTest-180742597 None] Lock "cinder-quobyte-d8cc4475-8fc2-433e-a02d-fe1b32f77e72" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:48 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-4473e826-ce5a-4bd8-9d8b-c312708948d3 tempest-SnapshotsActionsTest-180742597 None] Deleting offline snapshot d8cc4475-8fc2-433e-a02d-fe1b32f77e72 of volume 8a41d35c-59d5-468b-bb2e-921439713980 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:13:48 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-4473e826-ce5a-4bd8-9d8b-c312708948d3 tempest-SnapshotsActionsTest-180742597 None] snapshot_file for this snap is: volume-8a41d35c-59d5-468b-bb2e-921439713980.d8cc4475-8fc2-433e-a02d-fe1b32f77e72 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:13:48 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a60752b-09b4-40fc-b747-d8845d920e1f]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:13:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4473e826-ce5a-4bd8-9d8b-c312708948d3 tempest-SnapshotsActionsTest-180742597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.d8cc4475-8fc2-433e-a02d-fe1b32f77e72 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:48 devstack sudo[95056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.d8cc4475-8fc2-433e-a02d-fe1b32f77e72 Jul 10 18:13:48 devstack sudo[95056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:48 devstack sudo[95054]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5432dfe-9d6b-4e80-ad0d-bdcc28abbd85" returned: 0 in 0.676s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:48 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:13:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-fce3e80e-83ae-4eae-bd85-1f47f5ad385c tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.807s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:48 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-fce3e80e-83ae-4eae-bd85-1f47f5ad385c tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Creating offline snapshot ce2862fd-2512-429e-a891-8c36b4aa749b of volume 95be9209-4c37-4f61-89b1-9c99283e9012 {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:13:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d960317c-d614-4a2e-abec-20489db1fe6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5432dfe-9d6b-4e80-ad0d-bdcc28abbd85', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b4dd98e-bde4-42c6-bf1b-6caf3d619337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:48 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[f288d1aa-5a37-42c4-9c12-a9daf25a1c7a]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:13:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fce3e80e-83ae-4eae-bd85-1f47f5ad385c tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:48 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] Volume volume-b5432dfe-9d6b-4e80-ad0d-bdcc28abbd85 (b5432dfe-9d6b-4e80-ad0d-bdcc28abbd85): created successfully Jul 10 18:13:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b4dd98e-bde4-42c6-bf1b-6caf3d619337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] Flow 'volume_create_manager' (8641be12-a5ce-43ba-8666-ee597336419d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:13:48 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-4e3d7fb4-2e7e-4762-8e12-cd77d0b3524f tempest-VolumesActionsTest-1492668241 None] Created volume successfully. Jul 10 18:13:48 devstack sudo[95059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012 Jul 10 18:13:48 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:49 devstack sudo[95056]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4473e826-ce5a-4bd8-9d8b-c312708948d3 tempest-SnapshotsActionsTest-180742597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.d8cc4475-8fc2-433e-a02d-fe1b32f77e72" returned: 0 in 0.850s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:49 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-4473e826-ce5a-4bd8-9d8b-c312708948d3 tempest-SnapshotsActionsTest-180742597 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a41d35c-59d5-468b-bb2e-921439713980(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:13:49 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[8375e420-9fa8-4b5b-96fb-487d83ba12cb]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:13:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4473e826-ce5a-4bd8-9d8b-c312708948d3 tempest-SnapshotsActionsTest-180742597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:49 devstack sudo[95064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 Jul 10 18:13:49 devstack sudo[95064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:49 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fce3e80e-83ae-4eae-bd85-1f47f5ad385c tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012" returned: 0 in 0.844s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fce3e80e-83ae-4eae-bd85-1f47f5ad385c tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012.ce2862fd-2512-429e-a891-8c36b4aa749b 2G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:49 devstack sudo[95069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012.ce2862fd-2512-429e-a891-8c36b4aa749b 2G Jul 10 18:13:49 devstack sudo[95069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:49 devstack sudo[95064]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4473e826-ce5a-4bd8-9d8b-c312708948d3 tempest-SnapshotsActionsTest-180742597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41" returned: 0 in 0.865s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:49 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-4473e826-ce5a-4bd8-9d8b-c312708948d3 tempest-SnapshotsActionsTest-180742597 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a41d35c-59d5-468b-bb2e-921439713980(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:13:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4473e826-ce5a-4bd8-9d8b-c312708948d3 tempest-SnapshotsActionsTest-180742597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.d8cc4475-8fc2-433e-a02d-fe1b32f77e72 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:49 devstack sudo[95074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.d8cc4475-8fc2-433e-a02d-fe1b32f77e72 Jul 10 18:13:49 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:49 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8fbbee77-5d04-4306-9158-3c704a3500f5 tempest-VolumesActionsTest-1279522215 None] Acquiring lock "cinder-b5432dfe-9d6b-4e80-ad0d-bdcc28abbd85-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:50 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8fbbee77-5d04-4306-9158-3c704a3500f5 tempest-VolumesActionsTest-1279522215 None] Lock "cinder-b5432dfe-9d6b-4e80-ad0d-bdcc28abbd85-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:50 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8fbbee77-5d04-4306-9158-3c704a3500f5 tempest-VolumesActionsTest-1279522215 None] Acquiring lock "cinder-quobyte-b5432dfe-9d6b-4e80-ad0d-bdcc28abbd85" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:50 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8fbbee77-5d04-4306-9158-3c704a3500f5 tempest-VolumesActionsTest-1279522215 None] Lock "cinder-quobyte-b5432dfe-9d6b-4e80-ad0d-bdcc28abbd85" acquired by "delete_volume" :: waited 0.023s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:50 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fda77f9-f069-4146-a3eb-bdb727e73fa6]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:13:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8fbbee77-5d04-4306-9158-3c704a3500f5 tempest-VolumesActionsTest-1279522215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5432dfe-9d6b-4e80-ad0d-bdcc28abbd85 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:50 devstack sudo[95076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5432dfe-9d6b-4e80-ad0d-bdcc28abbd85 Jul 10 18:13:50 devstack sudo[95076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:50 devstack sudo[95069]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fce3e80e-83ae-4eae-bd85-1f47f5ad385c tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012.ce2862fd-2512-429e-a891-8c36b4aa749b 2G" returned: 0 in 1.115s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fce3e80e-83ae-4eae-bd85-1f47f5ad385c tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95be9209-4c37-4f61-89b1-9c99283e9012 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012.ce2862fd-2512-429e-a891-8c36b4aa749b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:50 devstack sudo[95085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95be9209-4c37-4f61-89b1-9c99283e9012 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012.ce2862fd-2512-429e-a891-8c36b4aa749b Jul 10 18:13:50 devstack sudo[95085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:50 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4473e826-ce5a-4bd8-9d8b-c312708948d3 tempest-SnapshotsActionsTest-180742597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.d8cc4475-8fc2-433e-a02d-fe1b32f77e72" returned: 0 in 0.933s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4473e826-ce5a-4bd8-9d8b-c312708948d3 tempest-SnapshotsActionsTest-180742597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.d8cc4475-8fc2-433e-a02d-fe1b32f77e72 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:50 devstack sudo[95087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.d8cc4475-8fc2-433e-a02d-fe1b32f77e72 Jul 10 18:13:50 devstack sudo[95087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:51 devstack sudo[95076]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8fbbee77-5d04-4306-9158-3c704a3500f5 tempest-VolumesActionsTest-1279522215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5432dfe-9d6b-4e80-ad0d-bdcc28abbd85" returned: 0 in 0.931s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8fbbee77-5d04-4306-9158-3c704a3500f5 tempest-VolumesActionsTest-1279522215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5432dfe-9d6b-4e80-ad0d-bdcc28abbd85 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:51 devstack sudo[95093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5432dfe-9d6b-4e80-ad0d-bdcc28abbd85 Jul 10 18:13:51 devstack sudo[95093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:51 devstack sudo[95085]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fce3e80e-83ae-4eae-bd85-1f47f5ad385c tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-95be9209-4c37-4f61-89b1-9c99283e9012 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012.ce2862fd-2512-429e-a891-8c36b4aa749b" returned: 0 in 0.836s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:51 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-fce3e80e-83ae-4eae-bd85-1f47f5ad385c tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012.ce2862fd-2512-429e-a891-8c36b4aa749b is being set with open permissions: ugo+rw Jul 10 18:13:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fce3e80e-83ae-4eae-bd85-1f47f5ad385c tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012.ce2862fd-2512-429e-a891-8c36b4aa749b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:51 devstack sudo[95100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012.ce2862fd-2512-429e-a891-8c36b4aa749b Jul 10 18:13:51 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:51 devstack sudo[95087]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4473e826-ce5a-4bd8-9d8b-c312708948d3 tempest-SnapshotsActionsTest-180742597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.d8cc4475-8fc2-433e-a02d-fe1b32f77e72" returned: 0 in 0.821s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:51 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4473e826-ce5a-4bd8-9d8b-c312708948d3 tempest-SnapshotsActionsTest-180742597 None] Lock "cinder-quobyte-d8cc4475-8fc2-433e-a02d-fe1b32f77e72" released by "_delete_snapshot" :: held 3.591s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:51 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4473e826-ce5a-4bd8-9d8b-c312708948d3 tempest-SnapshotsActionsTest-180742597 None] Lock "cinder-quobyte-8a41d35c-59d5-468b-bb2e-921439713980" released by "delete_snapshot" :: held 3.621s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:51 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-4473e826-ce5a-4bd8-9d8b-c312708948d3 tempest-SnapshotsActionsTest-180742597 None] Created reservations ['86abe9e1-46ab-45d4-b4f1-5c62a2bc5d54', 'd4b820cb-e65e-40a5-bc2d-4480977e3d71', '294aeb5e-de48-41fc-ae4f-c75a294ef2b1', 'c2c6e632-6e57-435f-9c97-c8f4a89bde81'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:13:51 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-4473e826-ce5a-4bd8-9d8b-c312708948d3 tempest-SnapshotsActionsTest-180742597 None] Delete snapshot completed successfully. Jul 10 18:13:51 devstack sudo[95093]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8fbbee77-5d04-4306-9158-3c704a3500f5 tempest-VolumesActionsTest-1279522215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5432dfe-9d6b-4e80-ad0d-bdcc28abbd85" returned: 0 in 0.843s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:51 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4473e826-ce5a-4bd8-9d8b-c312708948d3 tempest-SnapshotsActionsTest-180742597 None] Lock "cinder-d8cc4475-8fc2-433e-a02d-fe1b32f77e72-delete_snapshot" released by "delete_snapshot" :: held 3.825s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:51 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8fbbee77-5d04-4306-9158-3c704a3500f5 tempest-VolumesActionsTest-1279522215 None] Lock "cinder-quobyte-b5432dfe-9d6b-4e80-ad0d-bdcc28abbd85" released by "delete_volume" :: held 1.836s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:51 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-8fbbee77-5d04-4306-9158-3c704a3500f5 tempest-VolumesActionsTest-1279522215 None] Created reservations ['8c7a1d3d-5d30-4298-84b0-63b5c978496d', 'e82abeb4-01e6-4a86-a485-581f1b00085d', '050bc9b9-eb12-4449-9bc8-1e09b708c5df', '064c05a5-025b-44bf-bc4e-eb07a20942bf'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:13:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8fbbee77-5d04-4306-9158-3c704a3500f5 tempest-VolumesActionsTest-1279522215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8fbbee77-5d04-4306-9158-3c704a3500f5 tempest-VolumesActionsTest-1279522215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:52 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8fbbee77-5d04-4306-9158-3c704a3500f5 tempest-VolumesActionsTest-1279522215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:13:52 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8fbbee77-5d04-4306-9158-3c704a3500f5 tempest-VolumesActionsTest-1279522215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:13:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8fbbee77-5d04-4306-9158-3c704a3500f5 tempest-VolumesActionsTest-1279522215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8fbbee77-5d04-4306-9158-3c704a3500f5 tempest-VolumesActionsTest-1279522215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:52 devstack sudo[95103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:13:52 devstack sudo[95103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:52 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fce3e80e-83ae-4eae-bd85-1f47f5ad385c tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012.ce2862fd-2512-429e-a891-8c36b4aa749b" returned: 0 in 0.824s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fce3e80e-83ae-4eae-bd85-1f47f5ad385c tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:52 devstack sudo[95107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012.info Jul 10 18:13:52 devstack sudo[95107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-90d32a65-c62f-4c3c-a35a-7f41ab5b2191 tempest-SnapshotsActionsTest-446278604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:53 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:13:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] Flow 'volume_create_manager' (79f6ea32-6b18-4d2b-9683-7e61bb276080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:13:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ff5b258-ccb3-447b-96ad-13b954f4ec54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:53 devstack sudo[95103]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ff5b258-ccb3-447b-96ad-13b954f4ec54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1040015266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e18f57d9-8461-4fdf-90c3-1c8e8f47f8ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9bd296b8f834c89aa8abaafebe49877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:13:53Z,use_quota=True,user_id='942029a3e59a452e8c06b57e0b54fcab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1778507-667b-4077-bcde-8f5c0c663574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1778507-667b-4077-bcde-8f5c0c663574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (304c9f11-253b-47b5-b96f-74f5d967f7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (304c9f11-253b-47b5-b96f-74f5d967f7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e18f57d9-8461-4fdf-90c3-1c8e8f47f8ca', 'volume_name': 'volume-e18f57d9-8461-4fdf-90c3-1c8e8f47f8ca', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65945d5b-3f89-4e9d-a5de-12d37f2d4978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65945d5b-3f89-4e9d-a5de-12d37f2d4978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2890d029-b2df-4499-9808-96a50b9bb05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:53 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] Volume e18f57d9-8461-4fdf-90c3-1c8e8f47f8ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e18f57d9-8461-4fdf-90c3-1c8e8f47f8ca', 'volume_size': 1} Jul 10 18:13:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8fbbee77-5d04-4306-9158-3c704a3500f5 tempest-VolumesActionsTest-1279522215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.269s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:53 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-8fbbee77-5d04-4306-9158-3c704a3500f5 tempest-VolumesActionsTest-1279522215 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:13:53 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-8fbbee77-5d04-4306-9158-3c704a3500f5 tempest-VolumesActionsTest-1279522215 None] Deleted volume successfully. Jul 10 18:13:53 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8fbbee77-5d04-4306-9158-3c704a3500f5 tempest-VolumesActionsTest-1279522215 None] Lock "cinder-b5432dfe-9d6b-4e80-ad0d-bdcc28abbd85-delete_volume" released by "delete_volume" :: held 3.313s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:53 devstack sudo[95107]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fce3e80e-83ae-4eae-bd85-1f47f5ad385c tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012.info" returned: 0 in 0.995s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:53 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-fce3e80e-83ae-4eae-bd85-1f47f5ad385c tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012.info is being set with open permissions: ugo+rw Jul 10 18:13:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fce3e80e-83ae-4eae-bd85-1f47f5ad385c tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:53 devstack sudo[95112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012.info Jul 10 18:13:53 devstack sudo[95112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:54 devstack sudo[95112]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fce3e80e-83ae-4eae-bd85-1f47f5ad385c tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012.info" returned: 0 in 0.707s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-fce3e80e-83ae-4eae-bd85-1f47f5ad385c tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.517s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-90d32a65-c62f-4c3c-a35a-7f41ab5b2191 tempest-SnapshotsActionsTest-446278604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.115s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:54 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-90d32a65-c62f-4c3c-a35a-7f41ab5b2191 tempest-SnapshotsActionsTest-446278604 None] Creating offline snapshot 1c160f64-8ca8-4eee-9f10-653b92dcef55 of volume 8a41d35c-59d5-468b-bb2e-921439713980 {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:13:54 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-fce3e80e-83ae-4eae-bd85-1f47f5ad385c tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Create snapshot completed successfully Jul 10 18:13:54 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ad3985-e1c6-4574-8c85-d79236ff5282]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:13:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-90d32a65-c62f-4c3c-a35a-7f41ab5b2191 tempest-SnapshotsActionsTest-446278604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:54 devstack sudo[95121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 Jul 10 18:13:54 devstack sudo[95121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:54 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5bb5578f-0c4d-4c48-be40-a5451269c74d tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Acquiring lock "cinder-ce2862fd-2512-429e-a891-8c36b4aa749b-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:54 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5bb5578f-0c4d-4c48-be40-a5451269c74d tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Lock "cinder-ce2862fd-2512-429e-a891-8c36b4aa749b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:54 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5bb5578f-0c4d-4c48-be40-a5451269c74d tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Acquiring lock "cinder-quobyte-95be9209-4c37-4f61-89b1-9c99283e9012" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:54 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5bb5578f-0c4d-4c48-be40-a5451269c74d tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Lock "cinder-quobyte-95be9209-4c37-4f61-89b1-9c99283e9012" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:54 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5bb5578f-0c4d-4c48-be40-a5451269c74d tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Acquiring lock "cinder-quobyte-ce2862fd-2512-429e-a891-8c36b4aa749b" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:54 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5bb5578f-0c4d-4c48-be40-a5451269c74d tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Lock "cinder-quobyte-ce2862fd-2512-429e-a891-8c36b4aa749b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:54 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-5bb5578f-0c4d-4c48-be40-a5451269c74d tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Deleting offline snapshot ce2862fd-2512-429e-a891-8c36b4aa749b of volume 95be9209-4c37-4f61-89b1-9c99283e9012 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:13:54 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-5bb5578f-0c4d-4c48-be40-a5451269c74d tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] snapshot_file for this snap is: volume-95be9209-4c37-4f61-89b1-9c99283e9012.ce2862fd-2512-429e-a891-8c36b4aa749b {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:13:54 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6d24ca-2ed0-49a4-803d-bf7c3b9e1cdd]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:13:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5bb5578f-0c4d-4c48-be40-a5451269c74d tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012.ce2862fd-2512-429e-a891-8c36b4aa749b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:54 devstack sudo[95123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012.ce2862fd-2512-429e-a891-8c36b4aa749b Jul 10 18:13:54 devstack sudo[95123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:55 devstack sudo[95121]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-90d32a65-c62f-4c3c-a35a-7f41ab5b2191 tempest-SnapshotsActionsTest-446278604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41" returned: 0 in 0.800s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:55 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-90d32a65-c62f-4c3c-a35a-7f41ab5b2191 tempest-SnapshotsActionsTest-446278604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a41d35c-59d5-468b-bb2e-921439713980(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:13:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-90d32a65-c62f-4c3c-a35a-7f41ab5b2191 tempest-SnapshotsActionsTest-446278604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.1c160f64-8ca8-4eee-9f10-653b92dcef55 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:55 devstack sudo[95130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.1c160f64-8ca8-4eee-9f10-653b92dcef55 1G Jul 10 18:13:55 devstack sudo[95130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:55 devstack sudo[95123]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5bb5578f-0c4d-4c48-be40-a5451269c74d tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012.ce2862fd-2512-429e-a891-8c36b4aa749b" returned: 0 in 0.810s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:55 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-5bb5578f-0c4d-4c48-be40-a5451269c74d tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95be9209-4c37-4f61-89b1-9c99283e9012(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:13:55 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[0981a72a-2592-46b7-86d0-f189414120ed]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:13:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5bb5578f-0c4d-4c48-be40-a5451269c74d tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:55 devstack sudo[95136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012 Jul 10 18:13:55 devstack sudo[95136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:55 devstack sudo[95130]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-90d32a65-c62f-4c3c-a35a-7f41ab5b2191 tempest-SnapshotsActionsTest-446278604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.1c160f64-8ca8-4eee-9f10-653b92dcef55 1G" returned: 0 in 0.834s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-90d32a65-c62f-4c3c-a35a-7f41ab5b2191 tempest-SnapshotsActionsTest-446278604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.1c160f64-8ca8-4eee-9f10-653b92dcef55 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:56 devstack sudo[95141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.1c160f64-8ca8-4eee-9f10-653b92dcef55 Jul 10 18:13:56 devstack sudo[95141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:56 devstack sudo[95136]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5bb5578f-0c4d-4c48-be40-a5451269c74d tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012" returned: 0 in 0.806s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5bb5578f-0c4d-4c48-be40-a5451269c74d tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012.ce2862fd-2512-429e-a891-8c36b4aa749b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:56 devstack sudo[95146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012.ce2862fd-2512-429e-a891-8c36b4aa749b Jul 10 18:13:56 devstack sudo[95146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:56 devstack sudo[95141]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-90d32a65-c62f-4c3c-a35a-7f41ab5b2191 tempest-SnapshotsActionsTest-446278604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.1c160f64-8ca8-4eee-9f10-653b92dcef55" returned: 0 in 0.717s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:56 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-90d32a65-c62f-4c3c-a35a-7f41ab5b2191 tempest-SnapshotsActionsTest-446278604 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.1c160f64-8ca8-4eee-9f10-653b92dcef55 is being set with open permissions: ugo+rw Jul 10 18:13:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-90d32a65-c62f-4c3c-a35a-7f41ab5b2191 tempest-SnapshotsActionsTest-446278604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.1c160f64-8ca8-4eee-9f10-653b92dcef55 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:56 devstack sudo[95151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.1c160f64-8ca8-4eee-9f10-653b92dcef55 Jul 10 18:13:56 devstack sudo[95151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:57 devstack sudo[95146]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5bb5578f-0c4d-4c48-be40-a5451269c74d tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012.ce2862fd-2512-429e-a891-8c36b4aa749b" returned: 0 in 0.739s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5bb5578f-0c4d-4c48-be40-a5451269c74d tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012.ce2862fd-2512-429e-a891-8c36b4aa749b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:57 devstack sudo[95180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012.ce2862fd-2512-429e-a891-8c36b4aa749b Jul 10 18:13:57 devstack sudo[95180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:57 devstack sudo[95151]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-90d32a65-c62f-4c3c-a35a-7f41ab5b2191 tempest-SnapshotsActionsTest-446278604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.1c160f64-8ca8-4eee-9f10-653b92dcef55" returned: 0 in 0.662s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-90d32a65-c62f-4c3c-a35a-7f41ab5b2191 tempest-SnapshotsActionsTest-446278604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.125s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.129s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1040015266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e18f57d9-8461-4fdf-90c3-1c8e8f47f8ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9bd296b8f834c89aa8abaafebe49877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:13:53Z,use_quota=True,user_id='942029a3e59a452e8c06b57e0b54fcab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:13:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] Creating volume e18f57d9-8461-4fdf-90c3-1c8e8f47f8ca {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:13:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:13:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:13:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:13:57 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:13:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e18f57d9-8461-4fdf-90c3-1c8e8f47f8ca 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:57 devstack sudo[95183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e18f57d9-8461-4fdf-90c3-1c8e8f47f8ca 1073741824 Jul 10 18:13:57 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:57 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-90d32a65-c62f-4c3c-a35a-7f41ab5b2191 tempest-SnapshotsActionsTest-446278604 None] Create snapshot completed successfully Jul 10 18:13:57 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:13:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:13:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:13:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:13:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:13:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:57 devstack sudo[95185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:13:57 devstack sudo[95185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:57 devstack sudo[95180]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5bb5578f-0c4d-4c48-be40-a5451269c74d tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012.ce2862fd-2512-429e-a891-8c36b4aa749b" returned: 0 in 0.661s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5bb5578f-0c4d-4c48-be40-a5451269c74d tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Lock "cinder-quobyte-ce2862fd-2512-429e-a891-8c36b4aa749b" released by "_delete_snapshot" :: held 3.143s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5bb5578f-0c4d-4c48-be40-a5451269c74d tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Lock "cinder-quobyte-95be9209-4c37-4f61-89b1-9c99283e9012" released by "delete_snapshot" :: held 3.168s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:57 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-5bb5578f-0c4d-4c48-be40-a5451269c74d tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Created reservations ['85ab46a7-4702-4656-9add-4cb17d2532ec', '6c9bd8b3-17fc-4022-9ced-1cf64e336758', 'dedd7aeb-5d3f-443c-8ded-ce3dc06ce8b6', '57d31091-9c50-4fa9-b5e4-51798363fef8'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:13:57 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-5bb5578f-0c4d-4c48-be40-a5451269c74d tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Delete snapshot completed successfully. Jul 10 18:13:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5bb5578f-0c4d-4c48-be40-a5451269c74d tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Lock "cinder-ce2862fd-2512-429e-a891-8c36b4aa749b-delete_snapshot" released by "delete_snapshot" :: held 3.315s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:13:58 devstack sudo[95185]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.706s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:58 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:13:58 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager._thread_info {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:13:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread count: 28 {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 18:13:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread info: [<_MainThread(MainThread, started 139757428633728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 18:13:58 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ebb01212-042d-4311-a4b4-42921bfc1552 tempest-SnapshotsActionsTest-180742597 None] Acquiring lock "cinder-1c160f64-8ca8-4eee-9f10-653b92dcef55-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:58 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ebb01212-042d-4311-a4b4-42921bfc1552 tempest-SnapshotsActionsTest-180742597 None] Lock "cinder-1c160f64-8ca8-4eee-9f10-653b92dcef55-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:58 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ebb01212-042d-4311-a4b4-42921bfc1552 tempest-SnapshotsActionsTest-180742597 None] Acquiring lock "cinder-quobyte-8a41d35c-59d5-468b-bb2e-921439713980" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:58 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ebb01212-042d-4311-a4b4-42921bfc1552 tempest-SnapshotsActionsTest-180742597 None] Lock "cinder-quobyte-8a41d35c-59d5-468b-bb2e-921439713980" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:58 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ebb01212-042d-4311-a4b4-42921bfc1552 tempest-SnapshotsActionsTest-180742597 None] Acquiring lock "cinder-quobyte-1c160f64-8ca8-4eee-9f10-653b92dcef55" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:58 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ebb01212-042d-4311-a4b4-42921bfc1552 tempest-SnapshotsActionsTest-180742597 None] Lock "cinder-quobyte-1c160f64-8ca8-4eee-9f10-653b92dcef55" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-ebb01212-042d-4311-a4b4-42921bfc1552 tempest-SnapshotsActionsTest-180742597 None] Deleting offline snapshot 1c160f64-8ca8-4eee-9f10-653b92dcef55 of volume 8a41d35c-59d5-468b-bb2e-921439713980 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:13:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-ebb01212-042d-4311-a4b4-42921bfc1552 tempest-SnapshotsActionsTest-180742597 None] snapshot_file for this snap is: volume-8a41d35c-59d5-468b-bb2e-921439713980.1c160f64-8ca8-4eee-9f10-653b92dcef55 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:13:58 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e18f57d9-8461-4fdf-90c3-1c8e8f47f8ca 1073741824" returned: 0 in 0.953s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:58 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[a338d8f5-959c-4e27-a84d-40408abf65db]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:13:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ebb01212-042d-4311-a4b4-42921bfc1552 tempest-SnapshotsActionsTest-180742597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.1c160f64-8ca8-4eee-9f10-653b92dcef55 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e18f57d9-8461-4fdf-90c3-1c8e8f47f8ca {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:58 devstack sudo[95194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e18f57d9-8461-4fdf-90c3-1c8e8f47f8ca Jul 10 18:13:58 devstack sudo[95194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:58 devstack sudo[95193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.1c160f64-8ca8-4eee-9f10-653b92dcef55 Jul 10 18:13:58 devstack sudo[95193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:58 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-041a8af5-2da1-463f-9247-9ebad8c9155a tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Acquiring lock "cinder-95be9209-4c37-4f61-89b1-9c99283e9012-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:58 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-041a8af5-2da1-463f-9247-9ebad8c9155a tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Lock "cinder-95be9209-4c37-4f61-89b1-9c99283e9012-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:58 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-041a8af5-2da1-463f-9247-9ebad8c9155a tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Acquiring lock "cinder-quobyte-95be9209-4c37-4f61-89b1-9c99283e9012" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:13:58 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-041a8af5-2da1-463f-9247-9ebad8c9155a tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Lock "cinder-quobyte-95be9209-4c37-4f61-89b1-9c99283e9012" acquired by "delete_volume" :: waited 0.018s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:13:59 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e18211-7d97-458d-808b-75584368221a]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:13:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-041a8af5-2da1-463f-9247-9ebad8c9155a tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:59 devstack sudo[95194]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e18f57d9-8461-4fdf-90c3-1c8e8f47f8ca" returned: 0 in 0.683s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:59 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:13:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:13:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2890d029-b2df-4499-9808-96a50b9bb05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e18f57d9-8461-4fdf-90c3-1c8e8f47f8ca', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20baecca-4c5b-4a0b-8f55-9c750b09d9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:13:59 devstack sudo[95198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012 Jul 10 18:13:59 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:59 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] Volume volume-e18f57d9-8461-4fdf-90c3-1c8e8f47f8ca (e18f57d9-8461-4fdf-90c3-1c8e8f47f8ca): created successfully Jul 10 18:13:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20baecca-4c5b-4a0b-8f55-9c750b09d9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:13:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] Flow 'volume_create_manager' (79f6ea32-6b18-4d2b-9683-7e61bb276080) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:13:59 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-6fa88759-fa28-4b9d-82ba-077df2768d4f tempest-VolumesActionsTest-1492668241 None] Created volume successfully. Jul 10 18:13:59 devstack sudo[95193]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ebb01212-042d-4311-a4b4-42921bfc1552 tempest-SnapshotsActionsTest-180742597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.1c160f64-8ca8-4eee-9f10-653b92dcef55" returned: 0 in 0.867s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:59 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-ebb01212-042d-4311-a4b4-42921bfc1552 tempest-SnapshotsActionsTest-180742597 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a41d35c-59d5-468b-bb2e-921439713980(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:13:59 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b2bc13-00c5-433b-8256-50719b5a7eff]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:13:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ebb01212-042d-4311-a4b4-42921bfc1552 tempest-SnapshotsActionsTest-180742597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:59 devstack sudo[95210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 Jul 10 18:13:59 devstack sudo[95210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:13:59 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root Jul 10 18:13:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-041a8af5-2da1-463f-9247-9ebad8c9155a tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012" returned: 0 in 0.876s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:13:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-041a8af5-2da1-463f-9247-9ebad8c9155a tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:13:59 devstack sudo[95217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012 Jul 10 18:13:59 devstack sudo[95217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:00 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-30909638-6c34-4989-93a1-019742a5aef2 tempest-VolumesActionsTest-1492668241 None] Acquiring lock "cinder-e18f57d9-8461-4fdf-90c3-1c8e8f47f8ca-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:14:00 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-30909638-6c34-4989-93a1-019742a5aef2 tempest-VolumesActionsTest-1492668241 None] Lock "cinder-e18f57d9-8461-4fdf-90c3-1c8e8f47f8ca-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:14:00 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-30909638-6c34-4989-93a1-019742a5aef2 tempest-VolumesActionsTest-1492668241 None] Acquiring lock "cinder-quobyte-e18f57d9-8461-4fdf-90c3-1c8e8f47f8ca" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:14:00 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-30909638-6c34-4989-93a1-019742a5aef2 tempest-VolumesActionsTest-1492668241 None] Lock "cinder-quobyte-e18f57d9-8461-4fdf-90c3-1c8e8f47f8ca" acquired by "delete_volume" :: waited 0.021s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:14:00 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[963c181b-70b7-4671-8958-1e88297ff42a]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:14:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-30909638-6c34-4989-93a1-019742a5aef2 tempest-VolumesActionsTest-1492668241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e18f57d9-8461-4fdf-90c3-1c8e8f47f8ca {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:00 devstack sudo[95210]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ebb01212-042d-4311-a4b4-42921bfc1552 tempest-SnapshotsActionsTest-180742597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41" returned: 0 in 0.965s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-ebb01212-042d-4311-a4b4-42921bfc1552 tempest-SnapshotsActionsTest-180742597 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a41d35c-59d5-468b-bb2e-921439713980(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:14:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ebb01212-042d-4311-a4b4-42921bfc1552 tempest-SnapshotsActionsTest-180742597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.1c160f64-8ca8-4eee-9f10-653b92dcef55 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:00 devstack sudo[95223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.1c160f64-8ca8-4eee-9f10-653b92dcef55 Jul 10 18:14:00 devstack sudo[95223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:00 devstack sudo[95222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e18f57d9-8461-4fdf-90c3-1c8e8f47f8ca Jul 10 18:14:00 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:00 devstack sudo[95217]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-041a8af5-2da1-463f-9247-9ebad8c9155a tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-95be9209-4c37-4f61-89b1-9c99283e9012" returned: 0 in 0.809s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:00 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-041a8af5-2da1-463f-9247-9ebad8c9155a tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Lock "cinder-quobyte-95be9209-4c37-4f61-89b1-9c99283e9012" released by "delete_volume" :: held 1.763s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:14:00 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-041a8af5-2da1-463f-9247-9ebad8c9155a tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Created reservations ['735fd472-fe8d-409c-9670-622e2de21d7b', '4490b2a3-b8e3-484a-904e-dd48e59860e4', '29833e82-e351-4bad-abbe-621bdb48e12e', '3eb52d03-0696-46ca-8530-9ef78f1236e3'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:14:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-041a8af5-2da1-463f-9247-9ebad8c9155a tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:14:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-041a8af5-2da1-463f-9247-9ebad8c9155a tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:14:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-041a8af5-2da1-463f-9247-9ebad8c9155a tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:14:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-041a8af5-2da1-463f-9247-9ebad8c9155a tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:14:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-041a8af5-2da1-463f-9247-9ebad8c9155a tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:14:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-041a8af5-2da1-463f-9247-9ebad8c9155a tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:00 devstack sudo[95229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:14:00 devstack sudo[95229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:01 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-30909638-6c34-4989-93a1-019742a5aef2 tempest-VolumesActionsTest-1492668241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e18f57d9-8461-4fdf-90c3-1c8e8f47f8ca" returned: 0 in 0.963s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-30909638-6c34-4989-93a1-019742a5aef2 tempest-VolumesActionsTest-1492668241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e18f57d9-8461-4fdf-90c3-1c8e8f47f8ca {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:01 devstack sudo[95237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e18f57d9-8461-4fdf-90c3-1c8e8f47f8ca Jul 10 18:14:01 devstack sudo[95237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:01 devstack sudo[95223]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ebb01212-042d-4311-a4b4-42921bfc1552 tempest-SnapshotsActionsTest-180742597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.1c160f64-8ca8-4eee-9f10-653b92dcef55" returned: 0 in 1.075s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ebb01212-042d-4311-a4b4-42921bfc1552 tempest-SnapshotsActionsTest-180742597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.1c160f64-8ca8-4eee-9f10-653b92dcef55 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:01 devstack sudo[95239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.1c160f64-8ca8-4eee-9f10-653b92dcef55 Jul 10 18:14:01 devstack sudo[95239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:01 devstack sudo[95229]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-041a8af5-2da1-463f-9247-9ebad8c9155a tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.982s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:01 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-041a8af5-2da1-463f-9247-9ebad8c9155a tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:14:01 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-041a8af5-2da1-463f-9247-9ebad8c9155a tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Deleted volume successfully. Jul 10 18:14:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-041a8af5-2da1-463f-9247-9ebad8c9155a tempest-VolumesSnapshotNegativeTestJSON-1629617917 None] Lock "cinder-95be9209-4c37-4f61-89b1-9c99283e9012-delete_volume" released by "delete_volume" :: held 3.027s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:14:01 devstack sudo[95237]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-30909638-6c34-4989-93a1-019742a5aef2 tempest-VolumesActionsTest-1492668241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e18f57d9-8461-4fdf-90c3-1c8e8f47f8ca" returned: 0 in 0.812s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-30909638-6c34-4989-93a1-019742a5aef2 tempest-VolumesActionsTest-1492668241 None] Lock "cinder-quobyte-e18f57d9-8461-4fdf-90c3-1c8e8f47f8ca" released by "delete_volume" :: held 1.836s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:14:02 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-30909638-6c34-4989-93a1-019742a5aef2 tempest-VolumesActionsTest-1492668241 None] Created reservations ['0ef9e3a9-4858-4868-891c-518776cf2f00', 'cfc8590e-fe8d-4ab2-8bdc-46c55ea53374', '7920f409-c479-42eb-9860-1a5939fb2ffb', '46dd3708-4e43-42a4-85e3-95ace18885ff'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:14:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-30909638-6c34-4989-93a1-019742a5aef2 tempest-VolumesActionsTest-1492668241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:14:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-30909638-6c34-4989-93a1-019742a5aef2 tempest-VolumesActionsTest-1492668241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:14:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-30909638-6c34-4989-93a1-019742a5aef2 tempest-VolumesActionsTest-1492668241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:14:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-30909638-6c34-4989-93a1-019742a5aef2 tempest-VolumesActionsTest-1492668241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:14:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-30909638-6c34-4989-93a1-019742a5aef2 tempest-VolumesActionsTest-1492668241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:14:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-30909638-6c34-4989-93a1-019742a5aef2 tempest-VolumesActionsTest-1492668241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:02 devstack sudo[95244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:14:02 devstack sudo[95244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:02 devstack sudo[95239]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ebb01212-042d-4311-a4b4-42921bfc1552 tempest-SnapshotsActionsTest-180742597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.1c160f64-8ca8-4eee-9f10-653b92dcef55" returned: 0 in 0.875s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ebb01212-042d-4311-a4b4-42921bfc1552 tempest-SnapshotsActionsTest-180742597 None] Lock "cinder-quobyte-1c160f64-8ca8-4eee-9f10-653b92dcef55" released by "_delete_snapshot" :: held 3.920s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:14:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ebb01212-042d-4311-a4b4-42921bfc1552 tempest-SnapshotsActionsTest-180742597 None] Lock "cinder-quobyte-8a41d35c-59d5-468b-bb2e-921439713980" released by "delete_snapshot" :: held 3.948s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:14:02 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-ebb01212-042d-4311-a4b4-42921bfc1552 tempest-SnapshotsActionsTest-180742597 None] Created reservations ['047544b2-f9c0-4640-9b1d-8a65fdf46214', 'b7d3bc10-1c4c-4321-a383-9ac46dc78eee', '63dc94b6-1035-4444-a35a-d28a6a92bcf3', '810393ff-284f-4aec-a117-06eeefbb1984'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:14:02 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-ebb01212-042d-4311-a4b4-42921bfc1552 tempest-SnapshotsActionsTest-180742597 None] Delete snapshot completed successfully. Jul 10 18:14:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ebb01212-042d-4311-a4b4-42921bfc1552 tempest-SnapshotsActionsTest-180742597 None] Lock "cinder-1c160f64-8ca8-4eee-9f10-653b92dcef55-delete_snapshot" released by "delete_snapshot" :: held 4.131s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:14:02 devstack sudo[95244]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-30909638-6c34-4989-93a1-019742a5aef2 tempest-VolumesActionsTest-1492668241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.783s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:02 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-30909638-6c34-4989-93a1-019742a5aef2 tempest-VolumesActionsTest-1492668241 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:14:02 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-30909638-6c34-4989-93a1-019742a5aef2 tempest-VolumesActionsTest-1492668241 None] Deleted volume successfully. Jul 10 18:14:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-30909638-6c34-4989-93a1-019742a5aef2 tempest-VolumesActionsTest-1492668241 None] Lock "cinder-e18f57d9-8461-4fdf-90c3-1c8e8f47f8ca-delete_volume" released by "delete_volume" :: held 2.860s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:14:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-baf1c041-606e-44fc-b1f6-68eb61795a48 tempest-SnapshotsActionsTest-446278604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:14:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-baf1c041-606e-44fc-b1f6-68eb61795a48 tempest-SnapshotsActionsTest-446278604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:14:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-baf1c041-606e-44fc-b1f6-68eb61795a48 tempest-SnapshotsActionsTest-446278604 None] Creating offline snapshot 7e3cec3a-525b-4db2-a579-cbe22d61d5c9 of volume 8a41d35c-59d5-468b-bb2e-921439713980 {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:14:03 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a729a8-d148-443f-92ef-d6c54ad8a6c5]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:14:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-baf1c041-606e-44fc-b1f6-68eb61795a48 tempest-SnapshotsActionsTest-446278604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:03 devstack sudo[95247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 Jul 10 18:14:03 devstack sudo[95247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:03 devstack sudo[95247]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-baf1c041-606e-44fc-b1f6-68eb61795a48 tempest-SnapshotsActionsTest-446278604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41" returned: 0 in 0.855s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-baf1c041-606e-44fc-b1f6-68eb61795a48 tempest-SnapshotsActionsTest-446278604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a41d35c-59d5-468b-bb2e-921439713980(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:14:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-baf1c041-606e-44fc-b1f6-68eb61795a48 tempest-SnapshotsActionsTest-446278604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.7e3cec3a-525b-4db2-a579-cbe22d61d5c9 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:03 devstack sudo[95253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.7e3cec3a-525b-4db2-a579-cbe22d61d5c9 1G Jul 10 18:14:03 devstack sudo[95253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:04 devstack sudo[95253]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-baf1c041-606e-44fc-b1f6-68eb61795a48 tempest-SnapshotsActionsTest-446278604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.7e3cec3a-525b-4db2-a579-cbe22d61d5c9 1G" returned: 0 in 1.037s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-baf1c041-606e-44fc-b1f6-68eb61795a48 tempest-SnapshotsActionsTest-446278604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.7e3cec3a-525b-4db2-a579-cbe22d61d5c9 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:04 devstack sudo[95263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.7e3cec3a-525b-4db2-a579-cbe22d61d5c9 Jul 10 18:14:04 devstack sudo[95263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:05 devstack sudo[95263]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-baf1c041-606e-44fc-b1f6-68eb61795a48 tempest-SnapshotsActionsTest-446278604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.7e3cec3a-525b-4db2-a579-cbe22d61d5c9" returned: 0 in 1.000s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:05 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-baf1c041-606e-44fc-b1f6-68eb61795a48 tempest-SnapshotsActionsTest-446278604 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.7e3cec3a-525b-4db2-a579-cbe22d61d5c9 is being set with open permissions: ugo+rw Jul 10 18:14:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-baf1c041-606e-44fc-b1f6-68eb61795a48 tempest-SnapshotsActionsTest-446278604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.7e3cec3a-525b-4db2-a579-cbe22d61d5c9 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:05 devstack sudo[95269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.7e3cec3a-525b-4db2-a579-cbe22d61d5c9 Jul 10 18:14:05 devstack sudo[95269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:06 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-d86ab184-3110-4753-9750-22495d71e21f req-4b5c6fa3-790f-464a-88c6-aaeb2c5dad01 tempest-AttachVolumeTestJSON-309313673 None] Terminate volume connection completed successfully. Jul 10 18:14:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-d86ab184-3110-4753-9750-22495d71e21f req-4b5c6fa3-790f-464a-88c6-aaeb2c5dad01 tempest-AttachVolumeTestJSON-309313673 None] Deleting attachment 9d624165-5b2f-4a1d-93bc-3a84910970d5. {{(pid=87399) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 18:14:06 devstack sudo[95269]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-baf1c041-606e-44fc-b1f6-68eb61795a48 tempest-SnapshotsActionsTest-446278604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.7e3cec3a-525b-4db2-a579-cbe22d61d5c9" returned: 0 in 0.866s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-baf1c041-606e-44fc-b1f6-68eb61795a48 tempest-SnapshotsActionsTest-446278604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.863s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:14:06 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-baf1c041-606e-44fc-b1f6-68eb61795a48 tempest-SnapshotsActionsTest-446278604 None] Create snapshot completed successfully Jul 10 18:14:07 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-635362c7-fb17-4118-bbae-b9c734ed55b2 tempest-SnapshotsActionsTest-180742597 None] Acquiring lock "cinder-7e3cec3a-525b-4db2-a579-cbe22d61d5c9-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:14:07 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-635362c7-fb17-4118-bbae-b9c734ed55b2 tempest-SnapshotsActionsTest-180742597 None] Lock "cinder-7e3cec3a-525b-4db2-a579-cbe22d61d5c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:14:07 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-635362c7-fb17-4118-bbae-b9c734ed55b2 tempest-SnapshotsActionsTest-180742597 None] Acquiring lock "cinder-quobyte-8a41d35c-59d5-468b-bb2e-921439713980" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:14:07 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-635362c7-fb17-4118-bbae-b9c734ed55b2 tempest-SnapshotsActionsTest-180742597 None] Lock "cinder-quobyte-8a41d35c-59d5-468b-bb2e-921439713980" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:14:07 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-635362c7-fb17-4118-bbae-b9c734ed55b2 tempest-SnapshotsActionsTest-180742597 None] Acquiring lock "cinder-quobyte-7e3cec3a-525b-4db2-a579-cbe22d61d5c9" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:14:07 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-635362c7-fb17-4118-bbae-b9c734ed55b2 tempest-SnapshotsActionsTest-180742597 None] Lock "cinder-quobyte-7e3cec3a-525b-4db2-a579-cbe22d61d5c9" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:14:07 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-635362c7-fb17-4118-bbae-b9c734ed55b2 tempest-SnapshotsActionsTest-180742597 None] Deleting offline snapshot 7e3cec3a-525b-4db2-a579-cbe22d61d5c9 of volume 8a41d35c-59d5-468b-bb2e-921439713980 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:14:07 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-635362c7-fb17-4118-bbae-b9c734ed55b2 tempest-SnapshotsActionsTest-180742597 None] snapshot_file for this snap is: volume-8a41d35c-59d5-468b-bb2e-921439713980.7e3cec3a-525b-4db2-a579-cbe22d61d5c9 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:14:07 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8f56b6-edc4-4e09-b29e-59c9249f38b5]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:14:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-635362c7-fb17-4118-bbae-b9c734ed55b2 tempest-SnapshotsActionsTest-180742597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.7e3cec3a-525b-4db2-a579-cbe22d61d5c9 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:07 devstack sudo[95277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.7e3cec3a-525b-4db2-a579-cbe22d61d5c9 Jul 10 18:14:07 devstack sudo[95277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:08 devstack sudo[95277]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-635362c7-fb17-4118-bbae-b9c734ed55b2 tempest-SnapshotsActionsTest-180742597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.7e3cec3a-525b-4db2-a579-cbe22d61d5c9" returned: 0 in 0.973s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-635362c7-fb17-4118-bbae-b9c734ed55b2 tempest-SnapshotsActionsTest-180742597 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a41d35c-59d5-468b-bb2e-921439713980(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:14:08 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a02646f-91e9-48a2-a668-a01fe4e4d3fd]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:14:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-635362c7-fb17-4118-bbae-b9c734ed55b2 tempest-SnapshotsActionsTest-180742597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:08 devstack sudo[95283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 Jul 10 18:14:08 devstack sudo[95283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:09 devstack sudo[95283]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-635362c7-fb17-4118-bbae-b9c734ed55b2 tempest-SnapshotsActionsTest-180742597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41" returned: 0 in 0.871s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-635362c7-fb17-4118-bbae-b9c734ed55b2 tempest-SnapshotsActionsTest-180742597 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a41d35c-59d5-468b-bb2e-921439713980(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:14:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-635362c7-fb17-4118-bbae-b9c734ed55b2 tempest-SnapshotsActionsTest-180742597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.7e3cec3a-525b-4db2-a579-cbe22d61d5c9 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:09 devstack sudo[95293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.7e3cec3a-525b-4db2-a579-cbe22d61d5c9 Jul 10 18:14:09 devstack sudo[95293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:10 devstack sudo[95293]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-635362c7-fb17-4118-bbae-b9c734ed55b2 tempest-SnapshotsActionsTest-180742597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.7e3cec3a-525b-4db2-a579-cbe22d61d5c9" returned: 0 in 0.977s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-635362c7-fb17-4118-bbae-b9c734ed55b2 tempest-SnapshotsActionsTest-180742597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.7e3cec3a-525b-4db2-a579-cbe22d61d5c9 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:10 devstack sudo[95299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.7e3cec3a-525b-4db2-a579-cbe22d61d5c9 Jul 10 18:14:10 devstack sudo[95299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:11 devstack sudo[95299]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-635362c7-fb17-4118-bbae-b9c734ed55b2 tempest-SnapshotsActionsTest-180742597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.7e3cec3a-525b-4db2-a579-cbe22d61d5c9" returned: 0 in 0.726s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:11 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-635362c7-fb17-4118-bbae-b9c734ed55b2 tempest-SnapshotsActionsTest-180742597 None] Lock "cinder-quobyte-7e3cec3a-525b-4db2-a579-cbe22d61d5c9" released by "_delete_snapshot" :: held 3.668s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:14:11 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-635362c7-fb17-4118-bbae-b9c734ed55b2 tempest-SnapshotsActionsTest-180742597 None] Lock "cinder-quobyte-8a41d35c-59d5-468b-bb2e-921439713980" released by "delete_snapshot" :: held 3.699s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:14:11 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-635362c7-fb17-4118-bbae-b9c734ed55b2 tempest-SnapshotsActionsTest-180742597 None] Created reservations ['dbbc60a0-5677-42fc-b347-b155903551bc', '6ba0fdc4-7c0e-447f-bc94-5fb40efb4433', '8193f348-fe0d-44e3-9d90-dba9db461b49', '4765efb2-5d67-41d3-9d2f-bd7baaf319f3'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:14:11 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-635362c7-fb17-4118-bbae-b9c734ed55b2 tempest-SnapshotsActionsTest-180742597 None] Delete snapshot completed successfully. Jul 10 18:14:11 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-635362c7-fb17-4118-bbae-b9c734ed55b2 tempest-SnapshotsActionsTest-180742597 None] Lock "cinder-7e3cec3a-525b-4db2-a579-cbe22d61d5c9-delete_snapshot" released by "delete_snapshot" :: held 3.883s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:14:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d370b7b8-9633-4f0f-ba89-0962ec2addf7 tempest-SnapshotsActionsTest-446278604 None] Acquiring lock "cinder-5b1159b9-3736-4acf-9c3e-37a7b417ac41-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:14:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d370b7b8-9633-4f0f-ba89-0962ec2addf7 tempest-SnapshotsActionsTest-446278604 None] Lock "cinder-5b1159b9-3736-4acf-9c3e-37a7b417ac41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:14:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d370b7b8-9633-4f0f-ba89-0962ec2addf7 tempest-SnapshotsActionsTest-446278604 None] Acquiring lock "cinder-quobyte-8a41d35c-59d5-468b-bb2e-921439713980" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:14:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d370b7b8-9633-4f0f-ba89-0962ec2addf7 tempest-SnapshotsActionsTest-446278604 None] Lock "cinder-quobyte-8a41d35c-59d5-468b-bb2e-921439713980" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:14:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d370b7b8-9633-4f0f-ba89-0962ec2addf7 tempest-SnapshotsActionsTest-446278604 None] Acquiring lock "cinder-quobyte-5b1159b9-3736-4acf-9c3e-37a7b417ac41" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:14:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d370b7b8-9633-4f0f-ba89-0962ec2addf7 tempest-SnapshotsActionsTest-446278604 None] Lock "cinder-quobyte-5b1159b9-3736-4acf-9c3e-37a7b417ac41" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:14:12 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-d370b7b8-9633-4f0f-ba89-0962ec2addf7 tempest-SnapshotsActionsTest-446278604 None] Deleting offline snapshot 5b1159b9-3736-4acf-9c3e-37a7b417ac41 of volume 8a41d35c-59d5-468b-bb2e-921439713980 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:14:12 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-d370b7b8-9633-4f0f-ba89-0962ec2addf7 tempest-SnapshotsActionsTest-446278604 None] snapshot_file for this snap is: volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:14:12 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[08de1360-0986-4369-a79a-0b6d6137afa5]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:14:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d370b7b8-9633-4f0f-ba89-0962ec2addf7 tempest-SnapshotsActionsTest-446278604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:12 devstack sudo[95303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 Jul 10 18:14:12 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:13 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d370b7b8-9633-4f0f-ba89-0962ec2addf7 tempest-SnapshotsActionsTest-446278604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41" returned: 0 in 1.119s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:13 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-d370b7b8-9633-4f0f-ba89-0962ec2addf7 tempest-SnapshotsActionsTest-446278604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a41d35c-59d5-468b-bb2e-921439713980(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:14:13 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[79273069-81a3-45f3-994a-be217d1a518e]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:14:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d370b7b8-9633-4f0f-ba89-0962ec2addf7 tempest-SnapshotsActionsTest-446278604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:13 devstack sudo[95310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980 Jul 10 18:14:13 devstack sudo[95310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:14 devstack sudo[95310]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d370b7b8-9633-4f0f-ba89-0962ec2addf7 tempest-SnapshotsActionsTest-446278604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980" returned: 0 in 0.928s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d370b7b8-9633-4f0f-ba89-0962ec2addf7 tempest-SnapshotsActionsTest-446278604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:14 devstack sudo[95316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 Jul 10 18:14:14 devstack sudo[95316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:15 devstack sudo[95316]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d370b7b8-9633-4f0f-ba89-0962ec2addf7 tempest-SnapshotsActionsTest-446278604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41" returned: 0 in 0.911s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d370b7b8-9633-4f0f-ba89-0962ec2addf7 tempest-SnapshotsActionsTest-446278604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:15 devstack sudo[95322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41 Jul 10 18:14:15 devstack sudo[95322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:15 devstack sudo[95322]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d370b7b8-9633-4f0f-ba89-0962ec2addf7 tempest-SnapshotsActionsTest-446278604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980.5b1159b9-3736-4acf-9c3e-37a7b417ac41" returned: 0 in 0.705s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:16 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d370b7b8-9633-4f0f-ba89-0962ec2addf7 tempest-SnapshotsActionsTest-446278604 None] Lock "cinder-quobyte-5b1159b9-3736-4acf-9c3e-37a7b417ac41" released by "_delete_snapshot" :: held 3.786s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:14:16 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d370b7b8-9633-4f0f-ba89-0962ec2addf7 tempest-SnapshotsActionsTest-446278604 None] Lock "cinder-quobyte-8a41d35c-59d5-468b-bb2e-921439713980" released by "delete_snapshot" :: held 3.817s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:14:16 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-d370b7b8-9633-4f0f-ba89-0962ec2addf7 tempest-SnapshotsActionsTest-446278604 None] Created reservations ['46295d5c-7f7c-41a1-b55c-dc0ce1cd4390', 'a25884e3-fadc-4e35-9fa7-92ba14e4eab2', '31b7f676-1377-42b8-9c39-93f780c72693', '853de75d-6fe2-479b-ab51-1042d85e3eda'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:14:16 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-d370b7b8-9633-4f0f-ba89-0962ec2addf7 tempest-SnapshotsActionsTest-446278604 None] Delete snapshot completed successfully. Jul 10 18:14:16 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d370b7b8-9633-4f0f-ba89-0962ec2addf7 tempest-SnapshotsActionsTest-446278604 None] Lock "cinder-5b1159b9-3736-4acf-9c3e-37a7b417ac41-delete_snapshot" released by "delete_snapshot" :: held 3.982s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:14:16 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-be52b74b-c756-4879-953f-9c7f6b32a506 tempest-SnapshotsActionsTest-446278604 None] Acquiring lock "cinder-8a41d35c-59d5-468b-bb2e-921439713980-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:14:16 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-be52b74b-c756-4879-953f-9c7f6b32a506 tempest-SnapshotsActionsTest-446278604 None] Lock "cinder-8a41d35c-59d5-468b-bb2e-921439713980-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:14:16 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-be52b74b-c756-4879-953f-9c7f6b32a506 tempest-SnapshotsActionsTest-446278604 None] Acquiring lock "cinder-quobyte-8a41d35c-59d5-468b-bb2e-921439713980" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:14:16 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:14:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] Flow 'volume_create_manager' (1bc39a26-c750-4b2f-9dc3-4191b136b163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:14:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7297a6c6-9fd1-46ef-81d0-29c6ca26d0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:14:16 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-be52b74b-c756-4879-953f-9c7f6b32a506 tempest-SnapshotsActionsTest-446278604 None] Lock "cinder-quobyte-8a41d35c-59d5-468b-bb2e-921439713980" acquired by "delete_volume" :: waited 0.056s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:14:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7297a6c6-9fd1-46ef-81d0-29c6ca26d0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-104451269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=450ed0e2-40ad-4d98-a47f-b844260360e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b5d0207bb0e4ba79664f1a25c861a7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:14:17Z,use_quota=True,user_id='febf3eb4891146c2b3efe79d5f18d85c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:14:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68c97e3-863c-45d4-a60a-069b944e985b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:14:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f68c97e3-863c-45d4-a60a-069b944e985b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:14:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (171228cc-2aa0-463d-bc30-974175c6a6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:14:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (171228cc-2aa0-463d-bc30-974175c6a6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '450ed0e2-40ad-4d98-a47f-b844260360e3', 'volume_name': 'volume-450ed0e2-40ad-4d98-a47f-b844260360e3', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:14:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6da887b5-bfb8-421b-bc20-7b16f0f07450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:14:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6da887b5-bfb8-421b-bc20-7b16f0f07450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:14:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b1631a-6717-4970-a227-87fa31fc3907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:14:16 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] Volume 450ed0e2-40ad-4d98-a47f-b844260360e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-450ed0e2-40ad-4d98-a47f-b844260360e3', 'volume_size': 1} Jul 10 18:14:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:14:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:14:16 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-104451269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=450ed0e2-40ad-4d98-a47f-b844260360e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b5d0207bb0e4ba79664f1a25c861a7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:14:17Z,use_quota=True,user_id='febf3eb4891146c2b3efe79d5f18d85c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:14:16 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] Creating volume 450ed0e2-40ad-4d98-a47f-b844260360e3 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:14:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:14:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:14:16 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:14:16 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:14:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:14:16 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:14:16 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:14:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-450ed0e2-40ad-4d98-a47f-b844260360e3 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:16 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0c4de4-0d94-4c16-b9fc-72e915feb6aa]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:14:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-be52b74b-c756-4879-953f-9c7f6b32a506 tempest-SnapshotsActionsTest-446278604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:16 devstack sudo[95327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-450ed0e2-40ad-4d98-a47f-b844260360e3 1073741824 Jul 10 18:14:16 devstack sudo[95327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:17 devstack sudo[95328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980 Jul 10 18:14:17 devstack sudo[95328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:17 devstack sudo[95328]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-be52b74b-c756-4879-953f-9c7f6b32a506 tempest-SnapshotsActionsTest-446278604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980" returned: 0 in 1.012s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-be52b74b-c756-4879-953f-9c7f6b32a506 tempest-SnapshotsActionsTest-446278604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:17 devstack sudo[95350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980 Jul 10 18:14:17 devstack sudo[95350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:18 devstack sudo[95327]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-450ed0e2-40ad-4d98-a47f-b844260360e3 1073741824" returned: 0 in 1.259s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-450ed0e2-40ad-4d98-a47f-b844260360e3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:18 devstack sudo[95356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-450ed0e2-40ad-4d98-a47f-b844260360e3 Jul 10 18:14:18 devstack sudo[95356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:18 devstack sudo[95350]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-be52b74b-c756-4879-953f-9c7f6b32a506 tempest-SnapshotsActionsTest-446278604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8a41d35c-59d5-468b-bb2e-921439713980" returned: 0 in 0.883s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:18 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-be52b74b-c756-4879-953f-9c7f6b32a506 tempest-SnapshotsActionsTest-446278604 None] Lock "cinder-quobyte-8a41d35c-59d5-468b-bb2e-921439713980" released by "delete_volume" :: held 2.037s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:14:18 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-be52b74b-c756-4879-953f-9c7f6b32a506 tempest-SnapshotsActionsTest-446278604 None] Created reservations ['13645e07-e126-4584-a55e-51a09597e31e', '5732177d-257c-430f-92f3-c5158fb5f03d', '2fde889a-6b6c-4fcd-b675-acf45b1851b8', '612d0dbd-3ddb-465c-a0ec-0ad4ea82eb2e'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:14:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-be52b74b-c756-4879-953f-9c7f6b32a506 tempest-SnapshotsActionsTest-446278604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:14:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-be52b74b-c756-4879-953f-9c7f6b32a506 tempest-SnapshotsActionsTest-446278604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:14:18 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-be52b74b-c756-4879-953f-9c7f6b32a506 tempest-SnapshotsActionsTest-446278604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:14:18 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-be52b74b-c756-4879-953f-9c7f6b32a506 tempest-SnapshotsActionsTest-446278604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:14:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-be52b74b-c756-4879-953f-9c7f6b32a506 tempest-SnapshotsActionsTest-446278604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:14:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-be52b74b-c756-4879-953f-9c7f6b32a506 tempest-SnapshotsActionsTest-446278604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:18 devstack sudo[95356]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-450ed0e2-40ad-4d98-a47f-b844260360e3" returned: 0 in 0.845s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:18 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] <== create_volume: return (2173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:14:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.175s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:14:19 devstack sudo[95361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:14:19 devstack sudo[95361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b1631a-6717-4970-a227-87fa31fc3907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-450ed0e2-40ad-4d98-a47f-b844260360e3', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:14:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d790e657-3096-4f5f-a8c1-0121f9aff194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:14:19 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] Volume volume-450ed0e2-40ad-4d98-a47f-b844260360e3 (450ed0e2-40ad-4d98-a47f-b844260360e3): created successfully Jul 10 18:14:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d790e657-3096-4f5f-a8c1-0121f9aff194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:14:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] Flow 'volume_create_manager' (1bc39a26-c750-4b2f-9dc3-4191b136b163) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:14:19 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-a92f20a7-75aa-4aed-b8dd-82d6c3e40836 tempest-VolumesMetadataTest-1178236934 None] Created volume successfully. Jul 10 18:14:19 devstack sudo[95361]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-be52b74b-c756-4879-953f-9c7f6b32a506 tempest-SnapshotsActionsTest-446278604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.900s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:19 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-be52b74b-c756-4879-953f-9c7f6b32a506 tempest-SnapshotsActionsTest-446278604 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:14:19 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-be52b74b-c756-4879-953f-9c7f6b32a506 tempest-SnapshotsActionsTest-446278604 None] Deleted volume successfully. Jul 10 18:14:19 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-be52b74b-c756-4879-953f-9c7f6b32a506 tempest-SnapshotsActionsTest-446278604 None] Lock "cinder-8a41d35c-59d5-468b-bb2e-921439713980-delete_volume" released by "delete_volume" :: held 3.291s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:14:21 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-386321c5-d100-4f43-b300-b98dad4e4082 tempest-VolumesMetadataTest-1178236934 None] Acquiring lock "cinder-450ed0e2-40ad-4d98-a47f-b844260360e3-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:14:21 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-386321c5-d100-4f43-b300-b98dad4e4082 tempest-VolumesMetadataTest-1178236934 None] Lock "cinder-450ed0e2-40ad-4d98-a47f-b844260360e3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:14:21 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-386321c5-d100-4f43-b300-b98dad4e4082 tempest-VolumesMetadataTest-1178236934 None] Acquiring lock "cinder-quobyte-450ed0e2-40ad-4d98-a47f-b844260360e3" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:14:21 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-386321c5-d100-4f43-b300-b98dad4e4082 tempest-VolumesMetadataTest-1178236934 None] Lock "cinder-quobyte-450ed0e2-40ad-4d98-a47f-b844260360e3" acquired by "delete_volume" :: waited 0.034s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:14:21 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c76981-73db-466d-b991-e645bc300919]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:14:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-386321c5-d100-4f43-b300-b98dad4e4082 tempest-VolumesMetadataTest-1178236934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-450ed0e2-40ad-4d98-a47f-b844260360e3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:21 devstack sudo[95424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-450ed0e2-40ad-4d98-a47f-b844260360e3 Jul 10 18:14:21 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:22 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-386321c5-d100-4f43-b300-b98dad4e4082 tempest-VolumesMetadataTest-1178236934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-450ed0e2-40ad-4d98-a47f-b844260360e3" returned: 0 in 1.486s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-386321c5-d100-4f43-b300-b98dad4e4082 tempest-VolumesMetadataTest-1178236934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-450ed0e2-40ad-4d98-a47f-b844260360e3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:22 devstack sudo[95448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-450ed0e2-40ad-4d98-a47f-b844260360e3 Jul 10 18:14:22 devstack sudo[95448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:23 devstack sudo[95448]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-386321c5-d100-4f43-b300-b98dad4e4082 tempest-VolumesMetadataTest-1178236934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-450ed0e2-40ad-4d98-a47f-b844260360e3" returned: 0 in 1.130s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:23 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-386321c5-d100-4f43-b300-b98dad4e4082 tempest-VolumesMetadataTest-1178236934 None] Lock "cinder-quobyte-450ed0e2-40ad-4d98-a47f-b844260360e3" released by "delete_volume" :: held 2.689s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:14:23 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-386321c5-d100-4f43-b300-b98dad4e4082 tempest-VolumesMetadataTest-1178236934 None] Created reservations ['2fe1aed1-7e85-431a-8d04-a346ad51869a', 'a7bc93ed-4acf-496b-8d8a-72cfc8350c3b', '7ab072f8-b54d-4c39-bed0-28b75020e45d', '7a9a9d85-e846-48c3-a23c-5ef57da1c3a0'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:14:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-386321c5-d100-4f43-b300-b98dad4e4082 tempest-VolumesMetadataTest-1178236934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:14:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-386321c5-d100-4f43-b300-b98dad4e4082 tempest-VolumesMetadataTest-1178236934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:14:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-386321c5-d100-4f43-b300-b98dad4e4082 tempest-VolumesMetadataTest-1178236934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:14:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-386321c5-d100-4f43-b300-b98dad4e4082 tempest-VolumesMetadataTest-1178236934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:14:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-386321c5-d100-4f43-b300-b98dad4e4082 tempest-VolumesMetadataTest-1178236934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:14:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-386321c5-d100-4f43-b300-b98dad4e4082 tempest-VolumesMetadataTest-1178236934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:24 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:14:24 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:25 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-386321c5-d100-4f43-b300-b98dad4e4082 tempest-VolumesMetadataTest-1178236934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.300s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:25 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-386321c5-d100-4f43-b300-b98dad4e4082 tempest-VolumesMetadataTest-1178236934 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:14:25 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-386321c5-d100-4f43-b300-b98dad4e4082 tempest-VolumesMetadataTest-1178236934 None] Deleted volume successfully. Jul 10 18:14:25 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-386321c5-d100-4f43-b300-b98dad4e4082 tempest-VolumesMetadataTest-1178236934 None] Lock "cinder-450ed0e2-40ad-4d98-a47f-b844260360e3-delete_volume" released by "delete_volume" :: held 4.349s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:14:31 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:14:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] Flow 'volume_create_manager' (859fef11-c7cd-44e3-9489-fcf4024f78a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:14:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb8795e9-eb3f-4653-96ba-f8d80f96b00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:14:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb8795e9-eb3f-4653-96ba-f8d80f96b00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-822919150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71383329-8de3-42aa-8305-91d746f190b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e576a7346c794237bd3c0bf7d9d4498c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:14:32Z,use_quota=True,user_id='664bbe8ff4a64d5297f9592b6549223c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:14:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (278bff0a-25f3-44eb-902d-d69f5c4ba380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:14:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (278bff0a-25f3-44eb-902d-d69f5c4ba380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:14:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3060190d-bb62-4b75-8b6b-af875a1bc72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:14:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3060190d-bb62-4b75-8b6b-af875a1bc72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71383329-8de3-42aa-8305-91d746f190b9', 'volume_name': 'volume-71383329-8de3-42aa-8305-91d746f190b9', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:14:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77b563a6-d15f-464b-9528-a4997896e36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:14:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77b563a6-d15f-464b-9528-a4997896e36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:14:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6dd5535-cd47-4ae5-92a1-53506368880e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:14:31 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] Volume 71383329-8de3-42aa-8305-91d746f190b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71383329-8de3-42aa-8305-91d746f190b9', 'volume_size': 1} Jul 10 18:14:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:14:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:14:31 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-822919150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71383329-8de3-42aa-8305-91d746f190b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e576a7346c794237bd3c0bf7d9d4498c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:14:32Z,use_quota=True,user_id='664bbe8ff4a64d5297f9592b6549223c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:14:31 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] Creating volume 71383329-8de3-42aa-8305-91d746f190b9 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:14:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:14:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:14:31 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:14:31 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:14:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:14:31 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:14:31 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:14:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-71383329-8de3-42aa-8305-91d746f190b9 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:31 devstack sudo[95465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-71383329-8de3-42aa-8305-91d746f190b9 1073741824 Jul 10 18:14:31 devstack sudo[95465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:33 devstack sudo[95465]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-71383329-8de3-42aa-8305-91d746f190b9 1073741824" returned: 0 in 1.360s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-71383329-8de3-42aa-8305-91d746f190b9 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:33 devstack sudo[95472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-71383329-8de3-42aa-8305-91d746f190b9 Jul 10 18:14:33 devstack sudo[95472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:34 devstack sudo[95472]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-71383329-8de3-42aa-8305-91d746f190b9" returned: 0 in 1.094s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:34 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] <== create_volume: return (2524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:14:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.528s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:14:34 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6dd5535-cd47-4ae5-92a1-53506368880e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71383329-8de3-42aa-8305-91d746f190b9', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:14:34 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0208df9-f01f-4b8b-b0f3-531802fbb631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:14:34 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] Volume volume-71383329-8de3-42aa-8305-91d746f190b9 (71383329-8de3-42aa-8305-91d746f190b9): created successfully Jul 10 18:14:34 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0208df9-f01f-4b8b-b0f3-531802fbb631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:14:34 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] Flow 'volume_create_manager' (859fef11-c7cd-44e3-9489-fcf4024f78a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:14:34 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-feb8b706-c21d-4e4e-a043-9f2c13ef2737 tempest-VolumesTransfersV357Test-1570600290 None] Created volume successfully. Jul 10 18:14:35 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-6494ca1b-3d30-4eca-82b1-374235d863c1 tempest-VolumesTransfersV357Test-1632086119 None] Transfer volume completed successfully. Jul 10 18:14:36 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-58db8f6a-a961-4dae-9a2c-99b1938b69d1 tempest-VolumesTransfersV357Test-1772058136 None] Acquiring lock "cinder-71383329-8de3-42aa-8305-91d746f190b9-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:14:37 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-58db8f6a-a961-4dae-9a2c-99b1938b69d1 tempest-VolumesTransfersV357Test-1772058136 None] Lock "cinder-71383329-8de3-42aa-8305-91d746f190b9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:14:37 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-58db8f6a-a961-4dae-9a2c-99b1938b69d1 tempest-VolumesTransfersV357Test-1772058136 None] Acquiring lock "cinder-quobyte-71383329-8de3-42aa-8305-91d746f190b9" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:14:37 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-58db8f6a-a961-4dae-9a2c-99b1938b69d1 tempest-VolumesTransfersV357Test-1772058136 None] Lock "cinder-quobyte-71383329-8de3-42aa-8305-91d746f190b9" acquired by "delete_volume" :: waited 0.022s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:14:37 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0469a1-29a1-4d8d-aa08-33d958cc3a30]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:14:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-58db8f6a-a961-4dae-9a2c-99b1938b69d1 tempest-VolumesTransfersV357Test-1772058136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-71383329-8de3-42aa-8305-91d746f190b9 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:37 devstack sudo[95481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-71383329-8de3-42aa-8305-91d746f190b9 Jul 10 18:14:37 devstack sudo[95481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:37 devstack sudo[95481]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-58db8f6a-a961-4dae-9a2c-99b1938b69d1 tempest-VolumesTransfersV357Test-1772058136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-71383329-8de3-42aa-8305-91d746f190b9" returned: 0 in 0.827s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-58db8f6a-a961-4dae-9a2c-99b1938b69d1 tempest-VolumesTransfersV357Test-1772058136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-71383329-8de3-42aa-8305-91d746f190b9 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:37 devstack sudo[95489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-71383329-8de3-42aa-8305-91d746f190b9 Jul 10 18:14:37 devstack sudo[95489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:38 devstack sudo[95489]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-58db8f6a-a961-4dae-9a2c-99b1938b69d1 tempest-VolumesTransfersV357Test-1772058136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-71383329-8de3-42aa-8305-91d746f190b9" returned: 0 in 0.660s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:38 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-58db8f6a-a961-4dae-9a2c-99b1938b69d1 tempest-VolumesTransfersV357Test-1772058136 None] Lock "cinder-quobyte-71383329-8de3-42aa-8305-91d746f190b9" released by "delete_volume" :: held 1.536s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:14:38 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-58db8f6a-a961-4dae-9a2c-99b1938b69d1 tempest-VolumesTransfersV357Test-1772058136 None] Created reservations ['8ff8062d-54ba-4620-acbc-8ab6ac72c567', 'e6034fda-52ff-402c-9675-826585d3a73c', '18b4f445-dbc7-47bf-ab1a-b72e4a7d2d8b', 'cfeada47-be1b-4670-b735-47f1e29d0991'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:14:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-58db8f6a-a961-4dae-9a2c-99b1938b69d1 tempest-VolumesTransfersV357Test-1772058136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:14:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-58db8f6a-a961-4dae-9a2c-99b1938b69d1 tempest-VolumesTransfersV357Test-1772058136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:14:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-58db8f6a-a961-4dae-9a2c-99b1938b69d1 tempest-VolumesTransfersV357Test-1772058136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:14:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-58db8f6a-a961-4dae-9a2c-99b1938b69d1 tempest-VolumesTransfersV357Test-1772058136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:14:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-58db8f6a-a961-4dae-9a2c-99b1938b69d1 tempest-VolumesTransfersV357Test-1772058136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:14:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-58db8f6a-a961-4dae-9a2c-99b1938b69d1 tempest-VolumesTransfersV357Test-1772058136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:38 devstack sudo[95493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:14:38 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:39 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-58db8f6a-a961-4dae-9a2c-99b1938b69d1 tempest-VolumesTransfersV357Test-1772058136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.650s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:39 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-58db8f6a-a961-4dae-9a2c-99b1938b69d1 tempest-VolumesTransfersV357Test-1772058136 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:14:39 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-58db8f6a-a961-4dae-9a2c-99b1938b69d1 tempest-VolumesTransfersV357Test-1772058136 None] Deleted volume successfully. Jul 10 18:14:39 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-58db8f6a-a961-4dae-9a2c-99b1938b69d1 tempest-VolumesTransfersV357Test-1772058136 None] Lock "cinder-71383329-8de3-42aa-8305-91d746f190b9-delete_volume" released by "delete_volume" :: held 2.404s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:14:39 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:14:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] Flow 'volume_create_manager' (b81b315c-0620-4737-b94b-94b411192f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:14:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc009f5-ac1d-4b31-9456-62bc363e191f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:14:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bc009f5-ac1d-4b31-9456-62bc363e191f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1086876398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03ff61f-86f2-497d-a755-13b6cb06cc22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e576a7346c794237bd3c0bf7d9d4498c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:14:40Z,use_quota=True,user_id='664bbe8ff4a64d5297f9592b6549223c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:14:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ec43b8d-f162-4241-90fb-86c6784415bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:14:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ec43b8d-f162-4241-90fb-86c6784415bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:14:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc124927-61d2-40b2-8fb0-7cdc024174da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:14:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc124927-61d2-40b2-8fb0-7cdc024174da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f03ff61f-86f2-497d-a755-13b6cb06cc22', 'volume_name': 'volume-f03ff61f-86f2-497d-a755-13b6cb06cc22', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:14:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed8e329-bedf-4704-955c-60c689892c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:14:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ed8e329-bedf-4704-955c-60c689892c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:14:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06bf96eb-54d4-4a6e-af7a-0dae3dd0fbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:14:39 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] Volume f03ff61f-86f2-497d-a755-13b6cb06cc22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f03ff61f-86f2-497d-a755-13b6cb06cc22', 'volume_size': 1} Jul 10 18:14:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:14:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:14:39 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1086876398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f03ff61f-86f2-497d-a755-13b6cb06cc22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e576a7346c794237bd3c0bf7d9d4498c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:14:40Z,use_quota=True,user_id='664bbe8ff4a64d5297f9592b6549223c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:14:39 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] Creating volume f03ff61f-86f2-497d-a755-13b6cb06cc22 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:14:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:14:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:14:39 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:14:39 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:14:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:14:39 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:14:39 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:14:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f03ff61f-86f2-497d-a755-13b6cb06cc22 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:39 devstack sudo[95497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f03ff61f-86f2-497d-a755-13b6cb06cc22 1073741824 Jul 10 18:14:39 devstack sudo[95497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:40 devstack sudo[95497]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f03ff61f-86f2-497d-a755-13b6cb06cc22 1073741824" returned: 0 in 0.979s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f03ff61f-86f2-497d-a755-13b6cb06cc22 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:40 devstack sudo[95503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f03ff61f-86f2-497d-a755-13b6cb06cc22 Jul 10 18:14:40 devstack sudo[95503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:41 devstack sudo[95503]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f03ff61f-86f2-497d-a755-13b6cb06cc22" returned: 0 in 0.712s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:41 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] <== create_volume: return (1743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:14:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:14:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06bf96eb-54d4-4a6e-af7a-0dae3dd0fbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f03ff61f-86f2-497d-a755-13b6cb06cc22', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:14:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f0a149-3543-4a18-857d-bfce01bdff4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:14:41 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] Volume volume-f03ff61f-86f2-497d-a755-13b6cb06cc22 (f03ff61f-86f2-497d-a755-13b6cb06cc22): created successfully Jul 10 18:14:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6f0a149-3543-4a18-857d-bfce01bdff4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:14:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] Flow 'volume_create_manager' (b81b315c-0620-4737-b94b-94b411192f83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:14:41 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-19aa667e-84d7-4487-994f-e5de772e582b tempest-VolumesTransfersV357Test-1570600290 None] Created volume successfully. Jul 10 18:14:42 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b9148fbb-1e27-424e-993d-59371b054c16 tempest-VolumesTransfersV357Test-1772058136 None] Acquiring lock "cinder-f03ff61f-86f2-497d-a755-13b6cb06cc22-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:14:42 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b9148fbb-1e27-424e-993d-59371b054c16 tempest-VolumesTransfersV357Test-1772058136 None] Lock "cinder-f03ff61f-86f2-497d-a755-13b6cb06cc22-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:14:42 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b9148fbb-1e27-424e-993d-59371b054c16 tempest-VolumesTransfersV357Test-1772058136 None] Acquiring lock "cinder-quobyte-f03ff61f-86f2-497d-a755-13b6cb06cc22" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:14:42 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b9148fbb-1e27-424e-993d-59371b054c16 tempest-VolumesTransfersV357Test-1772058136 None] Lock "cinder-quobyte-f03ff61f-86f2-497d-a755-13b6cb06cc22" acquired by "delete_volume" :: waited 0.031s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:14:42 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75c56d0-d026-442a-972a-da01f020b09e]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:14:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b9148fbb-1e27-424e-993d-59371b054c16 tempest-VolumesTransfersV357Test-1772058136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f03ff61f-86f2-497d-a755-13b6cb06cc22 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:42 devstack sudo[95506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f03ff61f-86f2-497d-a755-13b6cb06cc22 Jul 10 18:14:42 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:43 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b9148fbb-1e27-424e-993d-59371b054c16 tempest-VolumesTransfersV357Test-1772058136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f03ff61f-86f2-497d-a755-13b6cb06cc22" returned: 0 in 0.953s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b9148fbb-1e27-424e-993d-59371b054c16 tempest-VolumesTransfersV357Test-1772058136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f03ff61f-86f2-497d-a755-13b6cb06cc22 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:43 devstack sudo[95525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f03ff61f-86f2-497d-a755-13b6cb06cc22 Jul 10 18:14:43 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:44 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b9148fbb-1e27-424e-993d-59371b054c16 tempest-VolumesTransfersV357Test-1772058136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f03ff61f-86f2-497d-a755-13b6cb06cc22" returned: 0 in 0.929s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:44 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b9148fbb-1e27-424e-993d-59371b054c16 tempest-VolumesTransfersV357Test-1772058136 None] Lock "cinder-quobyte-f03ff61f-86f2-497d-a755-13b6cb06cc22" released by "delete_volume" :: held 1.969s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:14:44 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-b9148fbb-1e27-424e-993d-59371b054c16 tempest-VolumesTransfersV357Test-1772058136 None] Created reservations ['4b95140c-5d19-4020-b317-ed5ac5c85fc8', 'da6eb2f9-8f5d-450d-8e53-a5afb56c798e', '39096b2a-fd77-4d7f-8891-c09048cdf54c', 'e07fcb5e-fca8-4190-8ae5-65798cc96157'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:14:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b9148fbb-1e27-424e-993d-59371b054c16 tempest-VolumesTransfersV357Test-1772058136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:14:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b9148fbb-1e27-424e-993d-59371b054c16 tempest-VolumesTransfersV357Test-1772058136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:14:44 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b9148fbb-1e27-424e-993d-59371b054c16 tempest-VolumesTransfersV357Test-1772058136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:14:44 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b9148fbb-1e27-424e-993d-59371b054c16 tempest-VolumesTransfersV357Test-1772058136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:14:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b9148fbb-1e27-424e-993d-59371b054c16 tempest-VolumesTransfersV357Test-1772058136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:14:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b9148fbb-1e27-424e-993d-59371b054c16 tempest-VolumesTransfersV357Test-1772058136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:44 devstack sudo[95556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:14:44 devstack sudo[95556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:45 devstack sudo[95556]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b9148fbb-1e27-424e-993d-59371b054c16 tempest-VolumesTransfersV357Test-1772058136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.099s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:45 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-b9148fbb-1e27-424e-993d-59371b054c16 tempest-VolumesTransfersV357Test-1772058136 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:14:45 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-b9148fbb-1e27-424e-993d-59371b054c16 tempest-VolumesTransfersV357Test-1772058136 None] Deleted volume successfully. Jul 10 18:14:45 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b9148fbb-1e27-424e-993d-59371b054c16 tempest-VolumesTransfersV357Test-1772058136 None] Lock "cinder-f03ff61f-86f2-497d-a755-13b6cb06cc22-delete_volume" released by "delete_volume" :: held 3.379s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:14:46 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:14:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Flow 'volume_create_manager' (a698170e-3588-4b87-9c74-821722bf15c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:14:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a87079f1-85fe-49f0-8f7e-ea3a19f129e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:14:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a87079f1-85fe-49f0-8f7e-ea3a19f129e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-489768618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5634fa-14b7-4881-91e5-0fac261b843a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='655b1adb94114479a320ff19689aa76d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:14:46Z,use_quota=True,user_id='7f0b09510eaa449b913ec6e95314965c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:14:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa255230-7ff9-4949-94b4-6c16c6493b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:14:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa255230-7ff9-4949-94b4-6c16c6493b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:14:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (321c2f00-63d0-4816-9979-ad0e17d217b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:14:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (321c2f00-63d0-4816-9979-ad0e17d217b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e5634fa-14b7-4881-91e5-0fac261b843a', 'volume_name': 'volume-1e5634fa-14b7-4881-91e5-0fac261b843a', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:14:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6419f677-328e-4524-a38d-684db6380a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:14:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6419f677-328e-4524-a38d-684db6380a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:14:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd42975a-b4e9-40c0-8842-b6be5c32aeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:14:46 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Volume 1e5634fa-14b7-4881-91e5-0fac261b843a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e5634fa-14b7-4881-91e5-0fac261b843a', 'volume_size': 1} Jul 10 18:14:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:14:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:14:46 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-489768618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5634fa-14b7-4881-91e5-0fac261b843a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='655b1adb94114479a320ff19689aa76d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:14:46Z,use_quota=True,user_id='7f0b09510eaa449b913ec6e95314965c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:14:46 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Creating volume 1e5634fa-14b7-4881-91e5-0fac261b843a {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:14:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:14:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:14:46 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:14:46 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:14:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:14:46 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:14:46 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:14:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:46 devstack sudo[95578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a 1073741824 Jul 10 18:14:46 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:47 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a 1073741824" returned: 0 in 1.082s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:47 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:UPDATE=101,cinder:SELECT=81,cinder:INSERT=29,cinder:DELETE=7 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:14:47 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=79,cinder:UPDATE=104,cinder:DELETE=9,cinder:INSERT=25 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:14:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:47 devstack sudo[95599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a Jul 10 18:14:47 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:48 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a" returned: 0 in 0.886s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:48 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] <== create_volume: return (2021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:14:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.023s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:14:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd42975a-b4e9-40c0-8842-b6be5c32aeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e5634fa-14b7-4881-91e5-0fac261b843a', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:14:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c6967ce-f69d-46ae-83b8-b71f26088abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:14:48 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Volume volume-1e5634fa-14b7-4881-91e5-0fac261b843a (1e5634fa-14b7-4881-91e5-0fac261b843a): created successfully Jul 10 18:14:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c6967ce-f69d-46ae-83b8-b71f26088abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:14:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Flow 'volume_create_manager' (a698170e-3588-4b87-9c74-821722bf15c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:14:48 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-2f8d9ebc-3da8-405b-b7a0-ddcd02fc9336 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Created volume successfully. Jul 10 18:14:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c0e59142-823f-4b0a-baf8-b731fb2a693c tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:14:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c0e59142-823f-4b0a-baf8-b731fb2a693c tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:14:49 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-c0e59142-823f-4b0a-baf8-b731fb2a693c tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Creating offline snapshot 9eb40c49-817b-4c50-9768-021197820d0e of volume 1e5634fa-14b7-4881-91e5-0fac261b843a {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:14:49 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f467dda-be87-4e81-8a48-abad5202ebb6]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:14:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c0e59142-823f-4b0a-baf8-b731fb2a693c tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:49 devstack sudo[95606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a Jul 10 18:14:49 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:50 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c0e59142-823f-4b0a-baf8-b731fb2a693c tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a" returned: 0 in 1.401s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c0e59142-823f-4b0a-baf8-b731fb2a693c tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a.9eb40c49-817b-4c50-9768-021197820d0e 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:50 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a.9eb40c49-817b-4c50-9768-021197820d0e 1G Jul 10 18:14:50 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:51 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c0e59142-823f-4b0a-baf8-b731fb2a693c tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a.9eb40c49-817b-4c50-9768-021197820d0e 1G" returned: 0 in 1.042s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c0e59142-823f-4b0a-baf8-b731fb2a693c tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e5634fa-14b7-4881-91e5-0fac261b843a -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a.9eb40c49-817b-4c50-9768-021197820d0e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:51 devstack sudo[95682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e5634fa-14b7-4881-91e5-0fac261b843a -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a.9eb40c49-817b-4c50-9768-021197820d0e Jul 10 18:14:51 devstack sudo[95682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:52 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:14:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] Flow 'volume_create_manager' (b8002511-7fed-4a7e-aad7-3b9d2278afa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:14:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a00aca9-b1f9-4859-b20f-0819231953f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:14:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a00aca9-b1f9-4859-b20f-0819231953f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-64136397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfddee04-0cba-4c16-9263-13a2695776ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78275a427e00460c8b35c2ac22e04d2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:14:52Z,use_quota=True,user_id='0f2d1259c4634f29b4b4f822cd313b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:14:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c1120c-2e42-4c14-90eb-a0c49f3ade6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:14:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c1120c-2e42-4c14-90eb-a0c49f3ade6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:14:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (312dd9f7-2739-466e-b965-9b844512673e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:14:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (312dd9f7-2739-466e-b965-9b844512673e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfddee04-0cba-4c16-9263-13a2695776ab', 'volume_name': 'volume-bfddee04-0cba-4c16-9263-13a2695776ab', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:14:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be07ea7-4409-42b3-93ce-dbbef14d4610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:14:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8be07ea7-4409-42b3-93ce-dbbef14d4610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:14:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6651cbc-b76f-4f26-b010-2d5db22c60cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:14:52 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] Volume bfddee04-0cba-4c16-9263-13a2695776ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfddee04-0cba-4c16-9263-13a2695776ab', 'volume_size': 1} Jul 10 18:14:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:14:52 devstack sudo[95682]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c0e59142-823f-4b0a-baf8-b731fb2a693c tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e5634fa-14b7-4881-91e5-0fac261b843a -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a.9eb40c49-817b-4c50-9768-021197820d0e" returned: 0 in 0.858s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:52 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-c0e59142-823f-4b0a-baf8-b731fb2a693c tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a.9eb40c49-817b-4c50-9768-021197820d0e is being set with open permissions: ugo+rw Jul 10 18:14:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c0e59142-823f-4b0a-baf8-b731fb2a693c tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a.9eb40c49-817b-4c50-9768-021197820d0e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:52 devstack sudo[95690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a.9eb40c49-817b-4c50-9768-021197820d0e Jul 10 18:14:52 devstack sudo[95690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:53 devstack sudo[95690]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c0e59142-823f-4b0a-baf8-b731fb2a693c tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a.9eb40c49-817b-4c50-9768-021197820d0e" returned: 0 in 0.937s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c0e59142-823f-4b0a-baf8-b731fb2a693c tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:53 devstack sudo[95693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a.info Jul 10 18:14:53 devstack sudo[95693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:54 devstack sudo[95693]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c0e59142-823f-4b0a-baf8-b731fb2a693c tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a.info" returned: 0 in 0.927s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:54 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-c0e59142-823f-4b0a-baf8-b731fb2a693c tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a.info is being set with open permissions: ugo+rw Jul 10 18:14:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c0e59142-823f-4b0a-baf8-b731fb2a693c tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:54 devstack sudo[95696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a.info Jul 10 18:14:54 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:55 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c0e59142-823f-4b0a-baf8-b731fb2a693c tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a.info" returned: 0 in 0.906s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c0e59142-823f-4b0a-baf8-b731fb2a693c tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.206s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:14:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.978s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:14:55 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:14:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-64136397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfddee04-0cba-4c16-9263-13a2695776ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78275a427e00460c8b35c2ac22e04d2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:14:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:14:52Z,use_quota=True,user_id='0f2d1259c4634f29b4b4f822cd313b29',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:14:55 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] Creating volume bfddee04-0cba-4c16-9263-13a2695776ab {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:14:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:14:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:14:55 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:14:55 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:14:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:14:55 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:14:55 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:14:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bfddee04-0cba-4c16-9263-13a2695776ab 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:55 devstack sudo[95702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bfddee04-0cba-4c16-9263-13a2695776ab 1073741824 Jul 10 18:14:55 devstack sudo[95702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:55 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-c0e59142-823f-4b0a-baf8-b731fb2a693c tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Create snapshot completed successfully Jul 10 18:14:56 devstack sudo[95702]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bfddee04-0cba-4c16-9263-13a2695776ab 1073741824" returned: 0 in 1.062s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bfddee04-0cba-4c16-9263-13a2695776ab {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:56 devstack sudo[95709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bfddee04-0cba-4c16-9263-13a2695776ab Jul 10 18:14:56 devstack sudo[95709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:57 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:14:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:14:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:14:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:14:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:14:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:14:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e1bcc210-8a73-4bc7-ba1d-f7fadb769f64 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Acquiring lock "cinder-9eb40c49-817b-4c50-9768-021197820d0e-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:14:57 devstack sudo[95714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:14:57 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e1bcc210-8a73-4bc7-ba1d-f7fadb769f64 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Lock "cinder-9eb40c49-817b-4c50-9768-021197820d0e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:14:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e1bcc210-8a73-4bc7-ba1d-f7fadb769f64 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Acquiring lock "cinder-quobyte-1e5634fa-14b7-4881-91e5-0fac261b843a" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:14:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e1bcc210-8a73-4bc7-ba1d-f7fadb769f64 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Lock "cinder-quobyte-1e5634fa-14b7-4881-91e5-0fac261b843a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:14:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e1bcc210-8a73-4bc7-ba1d-f7fadb769f64 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Acquiring lock "cinder-quobyte-9eb40c49-817b-4c50-9768-021197820d0e" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:14:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e1bcc210-8a73-4bc7-ba1d-f7fadb769f64 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Lock "cinder-quobyte-9eb40c49-817b-4c50-9768-021197820d0e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:14:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-e1bcc210-8a73-4bc7-ba1d-f7fadb769f64 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Deleting offline snapshot 9eb40c49-817b-4c50-9768-021197820d0e of volume 1e5634fa-14b7-4881-91e5-0fac261b843a {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:14:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-e1bcc210-8a73-4bc7-ba1d-f7fadb769f64 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] snapshot_file for this snap is: volume-1e5634fa-14b7-4881-91e5-0fac261b843a.9eb40c49-817b-4c50-9768-021197820d0e {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:14:57 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09beaf1-4f95-4cc7-aacd-9734f82dac5b]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:14:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e1bcc210-8a73-4bc7-ba1d-f7fadb769f64 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a.9eb40c49-817b-4c50-9768-021197820d0e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:57 devstack sudo[95709]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bfddee04-0cba-4c16-9263-13a2695776ab" returned: 0 in 1.116s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] <== create_volume: return (2250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:14:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.261s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:14:57 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6651cbc-b76f-4f26-b010-2d5db22c60cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfddee04-0cba-4c16-9263-13a2695776ab', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:14:57 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d625ab4c-f0ef-47c8-83c0-8def49330815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:14:57 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] Volume volume-bfddee04-0cba-4c16-9263-13a2695776ab (bfddee04-0cba-4c16-9263-13a2695776ab): created successfully Jul 10 18:14:57 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d625ab4c-f0ef-47c8-83c0-8def49330815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:14:57 devstack sudo[95717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a.9eb40c49-817b-4c50-9768-021197820d0e Jul 10 18:14:57 devstack sudo[95717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:57 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] Flow 'volume_create_manager' (b8002511-7fed-4a7e-aad7-3b9d2278afa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:14:57 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-a7526d7e-473f-4cc2-a33b-15ed29ace1c3 tempest-VolumesNegativeTest-891542220 None] Created volume successfully. Jul 10 18:14:58 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.955s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:58 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:14:58 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager._thread_info {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:14:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread count: 28 {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 18:14:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread info: [<_MainThread(MainThread, started 139757428633728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 18:14:58 devstack sudo[95717]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e1bcc210-8a73-4bc7-ba1d-f7fadb769f64 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a.9eb40c49-817b-4c50-9768-021197820d0e" returned: 0 in 0.930s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-e1bcc210-8a73-4bc7-ba1d-f7fadb769f64 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e5634fa-14b7-4881-91e5-0fac261b843a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:14:58 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0dd8387-335e-4cd0-980e-963d81c7b205]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:14:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e1bcc210-8a73-4bc7-ba1d-f7fadb769f64 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:58 devstack sudo[95723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a Jul 10 18:14:58 devstack sudo[95723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:14:59 devstack sudo[95723]: pam_unix(sudo:session): session closed for user root Jul 10 18:14:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e1bcc210-8a73-4bc7-ba1d-f7fadb769f64 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a" returned: 0 in 0.877s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:14:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e1bcc210-8a73-4bc7-ba1d-f7fadb769f64 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a.9eb40c49-817b-4c50-9768-021197820d0e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:14:59 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a.9eb40c49-817b-4c50-9768-021197820d0e Jul 10 18:14:59 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:00 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e1bcc210-8a73-4bc7-ba1d-f7fadb769f64 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a.9eb40c49-817b-4c50-9768-021197820d0e" returned: 0 in 0.909s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e1bcc210-8a73-4bc7-ba1d-f7fadb769f64 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a.9eb40c49-817b-4c50-9768-021197820d0e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:00 devstack sudo[95744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a.9eb40c49-817b-4c50-9768-021197820d0e Jul 10 18:15:00 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:01 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e1bcc210-8a73-4bc7-ba1d-f7fadb769f64 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a.9eb40c49-817b-4c50-9768-021197820d0e" returned: 0 in 0.698s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e1bcc210-8a73-4bc7-ba1d-f7fadb769f64 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Lock "cinder-quobyte-9eb40c49-817b-4c50-9768-021197820d0e" released by "_delete_snapshot" :: held 3.569s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:15:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e1bcc210-8a73-4bc7-ba1d-f7fadb769f64 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Lock "cinder-quobyte-1e5634fa-14b7-4881-91e5-0fac261b843a" released by "delete_snapshot" :: held 3.606s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:15:01 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-e1bcc210-8a73-4bc7-ba1d-f7fadb769f64 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Created reservations ['4f8fdd10-f9e3-4361-8434-49b2d7f85a65', '38cf8bde-065f-4e18-8155-baa3e20cc412', '606468de-0f65-47bb-9a19-53b164af25a9', 'dcb34d95-e8b4-4fc5-b7f1-4e5497b3137f'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:15:01 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-e1bcc210-8a73-4bc7-ba1d-f7fadb769f64 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Delete snapshot completed successfully. Jul 10 18:15:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e1bcc210-8a73-4bc7-ba1d-f7fadb769f64 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Lock "cinder-9eb40c49-817b-4c50-9768-021197820d0e-delete_snapshot" released by "delete_snapshot" :: held 3.801s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:15:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-9d24f391-63fa-402e-a053-263a987c1f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Acquiring lock "cinder-1e5634fa-14b7-4881-91e5-0fac261b843a-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:15:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-9d24f391-63fa-402e-a053-263a987c1f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Lock "cinder-1e5634fa-14b7-4881-91e5-0fac261b843a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:15:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-9d24f391-63fa-402e-a053-263a987c1f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Acquiring lock "cinder-quobyte-1e5634fa-14b7-4881-91e5-0fac261b843a" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:15:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-9d24f391-63fa-402e-a053-263a987c1f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Lock "cinder-quobyte-1e5634fa-14b7-4881-91e5-0fac261b843a" acquired by "delete_volume" :: waited 0.023s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:15:02 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf769eba-ad34-4f11-8aed-fb46711988b9]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:15:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9d24f391-63fa-402e-a053-263a987c1f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:02 devstack sudo[95750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a Jul 10 18:15:02 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:02 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9d24f391-63fa-402e-a053-263a987c1f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a" returned: 0 in 0.843s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9d24f391-63fa-402e-a053-263a987c1f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:02 devstack sudo[95755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a Jul 10 18:15:02 devstack sudo[95755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:03 devstack sudo[95755]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9d24f391-63fa-402e-a053-263a987c1f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e5634fa-14b7-4881-91e5-0fac261b843a" returned: 0 in 0.987s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:03 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-9d24f391-63fa-402e-a053-263a987c1f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Lock "cinder-quobyte-1e5634fa-14b7-4881-91e5-0fac261b843a" released by "delete_volume" :: held 1.923s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:15:04 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-9d24f391-63fa-402e-a053-263a987c1f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Created reservations ['86382219-e3c2-49dd-ad2a-5f70b1128d0c', '0fd43f3b-23b5-4d92-8d33-60688b30d5e4', 'c2c8b74d-e867-4260-9d2f-5350a2da71f9', '373f1913-9765-4b96-8938-46bcd57fe0b3'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:15:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9d24f391-63fa-402e-a053-263a987c1f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:15:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9d24f391-63fa-402e-a053-263a987c1f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:15:04 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9d24f391-63fa-402e-a053-263a987c1f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:15:04 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9d24f391-63fa-402e-a053-263a987c1f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:15:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9d24f391-63fa-402e-a053-263a987c1f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:15:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9d24f391-63fa-402e-a053-263a987c1f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:04 devstack sudo[95758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:15:04 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:05 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9d24f391-63fa-402e-a053-263a987c1f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.920s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:05 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-9d24f391-63fa-402e-a053-263a987c1f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:15:05 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-9d24f391-63fa-402e-a053-263a987c1f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Deleted volume successfully. Jul 10 18:15:05 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-9d24f391-63fa-402e-a053-263a987c1f29 tempest-VolumeSnapshotQuotasNegativeTestJSON-992179110 None] Lock "cinder-1e5634fa-14b7-4881-91e5-0fac261b843a-delete_volume" released by "delete_volume" :: held 3.178s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:15:13 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:15:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Flow 'volume_create_manager' (91faf0cf-77f1-4121-8d0c-ca0d32cb980b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:15:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e4bbd02-0ab4-46a5-80eb-b116495bf113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e4bbd02-0ab4-46a5-80eb-b116495bf113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1124039509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ba36e60-909b-497f-8584-0d7c07cd8280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5407fda65064490a527b03fe83de444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:15:14Z,use_quota=True,user_id='68933c7c51aa42f39c7ccc935bcdcc39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (752730cc-eb39-41f0-b1d3-7c5ff48eb6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (752730cc-eb39-41f0-b1d3-7c5ff48eb6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0a1ced-f54e-4593-b202-7adb6c4ee988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:13 devstack cinder-volume[87399]: DEBUG cinder.image.glance [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Creating Keystone auth plugin from conf {{(pid=87399) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 18:15:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0a1ced-f54e-4593-b202-7adb6c4ee988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0ba36e60-909b-497f-8584-0d7c07cd8280', 'volume_name': 'volume-0ba36e60-909b-497f-8584-0d7c07cd8280', 'volume_size': 1, 'image_id': '54228e05-a815-461c-8a75-0cdb9dee188c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54228e05-a815-461c-8a75-0cdb9dee188c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3cf5ba5785934cbfaf52674b9cb542ec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '54228e05-a815-461c-8a75-0cdb9dee188c', 'created_at': datetime.datetime(2026, 7, 10, 16, 0, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 16, 0, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54228e05-a815-461c-8a75-0cdb9dee188c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054d9847-bd08-4a74-a6dc-4f01fc3e1301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (054d9847-bd08-4a74-a6dc-4f01fc3e1301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b50e4a-ccd3-4823-ae8c-e75288a5122d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:14 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Volume 0ba36e60-909b-497f-8584-0d7c07cd8280: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0ba36e60-909b-497f-8584-0d7c07cd8280', 'volume_size': 1, 'image_id': '54228e05-a815-461c-8a75-0cdb9dee188c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54228e05-a815-461c-8a75-0cdb9dee188c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3cf5ba5785934cbfaf52674b9cb542ec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '54228e05-a815-461c-8a75-0cdb9dee188c', 'created_at': datetime.datetime(2026, 7, 10, 16, 0, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 16, 0, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54228e05-a815-461c-8a75-0cdb9dee188c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 18:15:14 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Trying to clone 0ba36e60-909b-497f-8584-0d7c07cd8280 from image 54228e05-a815-461c-8a75-0cdb9dee188c at location (None, [{'url': 'file:///opt/stack/data/glance/images/54228e05-a815-461c-8a75-0cdb9dee188c', 'metadata': {}}]). {{(pid=87399) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 18:15:14 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_mtjpfq3adevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87399) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 18:15:14 devstack cinder-volume[87399]: INFO cinder.image.image_utils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Image download 20.69 MB at 20.69 MB/s Jul 10 18:15:14 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a7d2c3-f4e0-48db-bfbd-3f5ca675b06d]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:15:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_mtjpfq3adevstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:15 devstack sudo[95953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_mtjpfq3adevstack@QuobyteHD Jul 10 18:15:15 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:16 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_mtjpfq3adevstack@QuobyteHD" returned: 0 in 1.288s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:16 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Temporary image 54228e05-a815-461c-8a75-0cdb9dee188c is fetched for user 68933c7c51aa42f39c7ccc935bcdcc39. {{(pid=87399) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 18:15:16 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[623d8843-4ba2-4693-9f4b-0e6c26f2341b]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:15:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_mtjpfq3adevstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:16 devstack sudo[95963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_mtjpfq3adevstack@QuobyteHD Jul 10 18:15:16 devstack sudo[95963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:17 devstack sudo[95963]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_mtjpfq3adevstack@QuobyteHD" returned: 0 in 1.198s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:15:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:15:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1124039509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ba36e60-909b-497f-8584-0d7c07cd8280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5407fda65064490a527b03fe83de444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:15:14Z,use_quota=True,user_id='68933c7c51aa42f39c7ccc935bcdcc39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:15:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Creating volume 0ba36e60-909b-497f-8584-0d7c07cd8280 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:15:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:15:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:15:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:15:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:15:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:15:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:15:17 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:15:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0ba36e60-909b-497f-8584-0d7c07cd8280 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:17 devstack sudo[95969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0ba36e60-909b-497f-8584-0d7c07cd8280 1073741824 Jul 10 18:15:17 devstack sudo[95969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:17 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:15:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Flow 'volume_create_manager' (a2ea2520-e209-473d-b8ae-d9f00aa337bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:15:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4bfb06-f1fb-45b6-b3d4-c35a3ac8a44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4bfb06-f1fb-45b6-b3d4-c35a3ac8a44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-607593063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d26eaac3-2154-4e5a-b2ad-152c27ee7622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cde345bf0c8409f971cd57933dcc810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:15:18Z,use_quota=True,user_id='f4847b7485b3465bab32079231c3f876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6da4ffa-15fa-41f8-bcda-a2355dcdb349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6da4ffa-15fa-41f8-bcda-a2355dcdb349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47aebd5c-b9e3-4aca-8073-76a6fdfc418a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47aebd5c-b9e3-4aca-8073-76a6fdfc418a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd26eaac3-2154-4e5a-b2ad-152c27ee7622', 'volume_name': 'volume-d26eaac3-2154-4e5a-b2ad-152c27ee7622', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (036e845e-d2cd-4a86-87ab-0e9f50e3bb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (036e845e-d2cd-4a86-87ab-0e9f50e3bb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707f465b-4880-4eae-8590-8d2a94e16d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:17 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Volume d26eaac3-2154-4e5a-b2ad-152c27ee7622: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d26eaac3-2154-4e5a-b2ad-152c27ee7622', 'volume_size': 1} Jul 10 18:15:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:15:19 devstack sudo[95969]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0ba36e60-909b-497f-8584-0d7c07cd8280 1073741824" returned: 0 in 1.569s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0ba36e60-909b-497f-8584-0d7c07cd8280 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:19 devstack sudo[95976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0ba36e60-909b-497f-8584-0d7c07cd8280 Jul 10 18:15:19 devstack sudo[95976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:20 devstack sudo[95976]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0ba36e60-909b-497f-8584-0d7c07cd8280" returned: 0 in 0.855s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:20 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] <== create_volume: return (2493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:15:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.499s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:15:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.234s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:15:20 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-607593063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d26eaac3-2154-4e5a-b2ad-152c27ee7622,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cde345bf0c8409f971cd57933dcc810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:15:18Z,use_quota=True,user_id='f4847b7485b3465bab32079231c3f876',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:15:20 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Creating volume d26eaac3-2154-4e5a-b2ad-152c27ee7622 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:15:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:15:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:15:20 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:15:20 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:15:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:15:20 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:15:20 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:15:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d26eaac3-2154-4e5a-b2ad-152c27ee7622 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:20 devstack sudo[95984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d26eaac3-2154-4e5a-b2ad-152c27ee7622 1073741824 Jul 10 18:15:20 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:20 devstack cinder-volume[87399]: DEBUG cinder.volume.volume_utils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Attempting download of 54228e05-a815-461c-8a75-0cdb9dee188c ((None, [{'url': 'file:///opt/stack/data/glance/images/54228e05-a815-461c-8a75-0cdb9dee188c', 'metadata': {}}])) to volume 0ba36e60-909b-497f-8584-0d7c07cd8280. {{(pid=87399) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 18:15:20 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40dcebc-a247-479b-a396-fcd39055b6cc]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:15:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54228e05-a815-461c-8a75-0cdb9dee188c_xoluo2yi {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:20 devstack sudo[95986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54228e05-a815-461c-8a75-0cdb9dee188c_xoluo2yi Jul 10 18:15:20 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:21 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54228e05-a815-461c-8a75-0cdb9dee188c_xoluo2yi" returned: 0 in 1.191s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54228e05-a815-461c-8a75-0cdb9dee188c_xoluo2yi {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:21 devstack sudo[96010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54228e05-a815-461c-8a75-0cdb9dee188c_xoluo2yi Jul 10 18:15:21 devstack sudo[96010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:21 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d26eaac3-2154-4e5a-b2ad-152c27ee7622 1073741824" returned: 0 in 1.641s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d26eaac3-2154-4e5a-b2ad-152c27ee7622 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:21 devstack sudo[96013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d26eaac3-2154-4e5a-b2ad-152c27ee7622 Jul 10 18:15:21 devstack sudo[96013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:22 devstack sudo[96010]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54228e05-a815-461c-8a75-0cdb9dee188c_xoluo2yi" returned: 1 in 1.067s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54228e05-a815-461c-8a75-0cdb9dee188c_xoluo2yi' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:15:22 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[68823132-b3e3-494d-a29a-00d368d5c1c8]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:15:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_mtjpfq3adevstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:22 devstack sudo[96019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_mtjpfq3adevstack@QuobyteHD Jul 10 18:15:22 devstack sudo[96019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:22 devstack sudo[96013]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d26eaac3-2154-4e5a-b2ad-152c27ee7622" returned: 0 in 0.950s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:22 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] <== create_volume: return (2665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:15:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.670s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:15:22 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707f465b-4880-4eae-8590-8d2a94e16d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d26eaac3-2154-4e5a-b2ad-152c27ee7622', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:22 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e57b2aba-8682-44ba-9b61-665d808b0f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:22 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Volume volume-d26eaac3-2154-4e5a-b2ad-152c27ee7622 (d26eaac3-2154-4e5a-b2ad-152c27ee7622): created successfully Jul 10 18:15:22 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e57b2aba-8682-44ba-9b61-665d808b0f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:22 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Flow 'volume_create_manager' (a2ea2520-e209-473d-b8ae-d9f00aa337bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:15:22 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-101778c9-b360-4604-a4e2-336ae5ed166a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Created volume successfully. Jul 10 18:15:23 devstack sudo[96019]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_mtjpfq3adevstack@QuobyteHD" returned: 0 in 1.029s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:23 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] 54228e05-a815-461c-8a75-0cdb9dee188c was qcow2, converting to raw {{(pid=87399) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 18:15:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_mtjpfq3adevstack@QuobyteHD /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0ba36e60-909b-497f-8584-0d7c07cd8280 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:23 devstack sudo[96036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_mtjpfq3adevstack@QuobyteHD /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0ba36e60-909b-497f-8584-0d7c07cd8280 Jul 10 18:15:23 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:25 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_mtjpfq3adevstack@QuobyteHD /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0ba36e60-909b-497f-8584-0d7c07cd8280" returned: 0 in 2.193s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:25 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_mtjpfq3adevstack@QuobyteHD, size 112.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0ba36e60-909b-497f-8584-0d7c07cd8280 {{(pid=87399) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 18:15:25 devstack cinder-volume[87399]: INFO cinder.image.image_utils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Converted 112.00 MB image at 51.04 MB/s Jul 10 18:15:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0ba36e60-909b-497f-8584-0d7c07cd8280 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:25 devstack sudo[96078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0ba36e60-909b-497f-8584-0d7c07cd8280 1G Jul 10 18:15:25 devstack sudo[96078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-b0724d65-a1be-4c61-902b-0fccc9fcc4e0 req-659961b2-557e-484f-a146-e699c2357b4f tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:15:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-b0724d65-a1be-4c61-902b-0fccc9fcc4e0 req-659961b2-557e-484f-a146-e699c2357b4f tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:15:26 devstack sudo[96078]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0ba36e60-909b-497f-8584-0d7c07cd8280 1G" returned: 0 in 0.758s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:26 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[740d7997-e0c3-4041-aa14-63ed267217c4]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:15:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-b0724d65-a1be-4c61-902b-0fccc9fcc4e0 req-659961b2-557e-484f-a146-e699c2357b4f tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d26eaac3-2154-4e5a-b2ad-152c27ee7622 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:26 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[6045943e-93bf-4e29-97fd-8803814a5076]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:15:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0ba36e60-909b-497f-8584-0d7c07cd8280 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:26 devstack sudo[96092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d26eaac3-2154-4e5a-b2ad-152c27ee7622 Jul 10 18:15:26 devstack sudo[96092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:26 devstack sudo[96093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0ba36e60-909b-497f-8584-0d7c07cd8280 Jul 10 18:15:26 devstack sudo[96093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:27 devstack sudo[96093]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0ba36e60-909b-497f-8584-0d7c07cd8280" returned: 0 in 0.828s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0ba36e60-909b-497f-8584-0d7c07cd8280 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:27 devstack sudo[96092]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-b0724d65-a1be-4c61-902b-0fccc9fcc4e0 req-659961b2-557e-484f-a146-e699c2357b4f tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d26eaac3-2154-4e5a-b2ad-152c27ee7622" returned: 0 in 0.987s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:27 devstack sudo[96102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0ba36e60-909b-497f-8584-0d7c07cd8280 Jul 10 18:15:27 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-b0724d65-a1be-4c61-902b-0fccc9fcc4e0 req-659961b2-557e-484f-a146-e699c2357b4f tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.010s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:15:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-b0724d65-a1be-4c61-902b-0fccc9fcc4e0 req-659961b2-557e-484f-a146-e699c2357b4f tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd', 'name': 'volume-d26eaac3-2154-4e5a-b2ad-152c27ee7622', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b8b39e79-7980-4d4f-ae4f-2e1b8e1051fa', 'enforce_multipath': True} {{(pid=87399) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 18:15:27 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-b0724d65-a1be-4c61-902b-0fccc9fcc4e0 req-659961b2-557e-484f-a146-e699c2357b4f tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] attachment_update completed successfully. Jul 10 18:15:28 devstack sudo[96102]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0ba36e60-909b-497f-8584-0d7c07cd8280" returned: 1 in 0.790s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0ba36e60-909b-497f-8584-0d7c07cd8280' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:15:28 devstack cinder-volume[87399]: DEBUG cinder.volume.volume_utils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Downloaded image 54228e05-a815-461c-8a75-0cdb9dee188c ((None, [{'url': 'file:///opt/stack/data/glance/images/54228e05-a815-461c-8a75-0cdb9dee188c', 'metadata': {}}])) to volume 0ba36e60-909b-497f-8584-0d7c07cd8280 successfully. {{(pid=87399) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 18:15:28 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Temporary image 54228e05-a815-461c-8a75-0cdb9dee188c for user 68933c7c51aa42f39c7ccc935bcdcc39 is deleted. {{(pid=87399) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 18:15:28 devstack cinder-volume[87399]: DEBUG cinder.volume.volume_utils [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Marking volume 0ba36e60-909b-497f-8584-0d7c07cd8280 as bootable. {{(pid=87399) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 18:15:28 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Copying metadata from image 54228e05-a815-461c-8a75-0cdb9dee188c to 0ba36e60-909b-497f-8584-0d7c07cd8280. {{(pid=87399) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 18:15:28 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Creating volume glance metadata for volume 0ba36e60-909b-497f-8584-0d7c07cd8280 backed by image 54228e05-a815-461c-8a75-0cdb9dee188c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '54228e05-a815-461c-8a75-0cdb9dee188c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87399) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 18:15:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b50e4a-ccd3-4823-ae8c-e75288a5122d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ba36e60-909b-497f-8584-0d7c07cd8280', 'volume_size': 1, 'image_id': '54228e05-a815-461c-8a75-0cdb9dee188c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54228e05-a815-461c-8a75-0cdb9dee188c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3cf5ba5785934cbfaf52674b9cb542ec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '54228e05-a815-461c-8a75-0cdb9dee188c', 'created_at': datetime.datetime(2026, 7, 10, 16, 0, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 16, 0, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54228e05-a815-461c-8a75-0cdb9dee188c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02efbfa5-68be-490b-85d4-58d30828d6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:28 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Volume volume-0ba36e60-909b-497f-8584-0d7c07cd8280 (0ba36e60-909b-497f-8584-0d7c07cd8280): created successfully Jul 10 18:15:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02efbfa5-68be-490b-85d4-58d30828d6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Flow 'volume_create_manager' (91faf0cf-77f1-4121-8d0c-ca0d32cb980b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:15:28 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-f02ec0e4-19ca-4103-85ca-8393d9fa072f tempest-VolumesImageMetadata-129496451 None] Created volume successfully. Jul 10 18:15:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7da7035a-518d-42c0-a7ca-5012b9460737 tempest-VolumesImageMetadata-129496451 None] Acquiring lock "cinder-0ba36e60-909b-497f-8584-0d7c07cd8280-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:15:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7da7035a-518d-42c0-a7ca-5012b9460737 tempest-VolumesImageMetadata-129496451 None] Lock "cinder-0ba36e60-909b-497f-8584-0d7c07cd8280-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:15:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7da7035a-518d-42c0-a7ca-5012b9460737 tempest-VolumesImageMetadata-129496451 None] Acquiring lock "cinder-quobyte-0ba36e60-909b-497f-8584-0d7c07cd8280" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:15:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7da7035a-518d-42c0-a7ca-5012b9460737 tempest-VolumesImageMetadata-129496451 None] Lock "cinder-quobyte-0ba36e60-909b-497f-8584-0d7c07cd8280" acquired by "delete_volume" :: waited 0.017s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:15:29 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[19056a13-dc35-43c0-b628-f39dba42ba62]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:15:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7da7035a-518d-42c0-a7ca-5012b9460737 tempest-VolumesImageMetadata-129496451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0ba36e60-909b-497f-8584-0d7c07cd8280 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:29 devstack sudo[96492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0ba36e60-909b-497f-8584-0d7c07cd8280 Jul 10 18:15:29 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:30 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7da7035a-518d-42c0-a7ca-5012b9460737 tempest-VolumesImageMetadata-129496451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0ba36e60-909b-497f-8584-0d7c07cd8280" returned: 0 in 0.819s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7da7035a-518d-42c0-a7ca-5012b9460737 tempest-VolumesImageMetadata-129496451 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0ba36e60-909b-497f-8584-0d7c07cd8280 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:30 devstack sudo[96496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0ba36e60-909b-497f-8584-0d7c07cd8280 Jul 10 18:15:30 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:31 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7da7035a-518d-42c0-a7ca-5012b9460737 tempest-VolumesImageMetadata-129496451 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0ba36e60-909b-497f-8584-0d7c07cd8280" returned: 1 in 0.780s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7da7035a-518d-42c0-a7ca-5012b9460737 tempest-VolumesImageMetadata-129496451 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0ba36e60-909b-497f-8584-0d7c07cd8280' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:15:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7da7035a-518d-42c0-a7ca-5012b9460737 tempest-VolumesImageMetadata-129496451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0ba36e60-909b-497f-8584-0d7c07cd8280 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:31 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0ba36e60-909b-497f-8584-0d7c07cd8280 Jul 10 18:15:31 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:31 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7da7035a-518d-42c0-a7ca-5012b9460737 tempest-VolumesImageMetadata-129496451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0ba36e60-909b-497f-8584-0d7c07cd8280" returned: 0 in 0.722s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:31 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7da7035a-518d-42c0-a7ca-5012b9460737 tempest-VolumesImageMetadata-129496451 None] Lock "cinder-quobyte-0ba36e60-909b-497f-8584-0d7c07cd8280" released by "delete_volume" :: held 2.382s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:15:32 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-7da7035a-518d-42c0-a7ca-5012b9460737 tempest-VolumesImageMetadata-129496451 None] Created reservations ['a8b3de4f-b339-4e96-871e-0be7d9ccc799', '38f82c11-ccc6-42e7-a61d-a96352369e1a', 'e2809553-cf51-4806-8ea3-45d78d018cfc', '367f763c-ed78-4e46-b2cc-11b78fb8d6c8'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:15:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7da7035a-518d-42c0-a7ca-5012b9460737 tempest-VolumesImageMetadata-129496451 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:15:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7da7035a-518d-42c0-a7ca-5012b9460737 tempest-VolumesImageMetadata-129496451 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:15:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7da7035a-518d-42c0-a7ca-5012b9460737 tempest-VolumesImageMetadata-129496451 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:15:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7da7035a-518d-42c0-a7ca-5012b9460737 tempest-VolumesImageMetadata-129496451 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:15:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7da7035a-518d-42c0-a7ca-5012b9460737 tempest-VolumesImageMetadata-129496451 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:15:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7da7035a-518d-42c0-a7ca-5012b9460737 tempest-VolumesImageMetadata-129496451 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:32 devstack sudo[96504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:15:32 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:32 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7da7035a-518d-42c0-a7ca-5012b9460737 tempest-VolumesImageMetadata-129496451 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.836s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:32 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-7da7035a-518d-42c0-a7ca-5012b9460737 tempest-VolumesImageMetadata-129496451 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:15:32 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-7da7035a-518d-42c0-a7ca-5012b9460737 tempest-VolumesImageMetadata-129496451 None] Deleted volume successfully. Jul 10 18:15:33 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7da7035a-518d-42c0-a7ca-5012b9460737 tempest-VolumesImageMetadata-129496451 None] Lock "cinder-0ba36e60-909b-497f-8584-0d7c07cd8280-delete_volume" released by "delete_volume" :: held 3.546s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:15:33 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-759d48be-1fa3-4d04-a35a-171535ba4e88 tempest-VolumesNegativeTest-891542220 None] Acquiring lock "cinder-bfddee04-0cba-4c16-9263-13a2695776ab-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:15:33 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-759d48be-1fa3-4d04-a35a-171535ba4e88 tempest-VolumesNegativeTest-891542220 None] Lock "cinder-bfddee04-0cba-4c16-9263-13a2695776ab-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:15:33 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-759d48be-1fa3-4d04-a35a-171535ba4e88 tempest-VolumesNegativeTest-891542220 None] Acquiring lock "cinder-quobyte-bfddee04-0cba-4c16-9263-13a2695776ab" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:15:33 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-759d48be-1fa3-4d04-a35a-171535ba4e88 tempest-VolumesNegativeTest-891542220 None] Lock "cinder-quobyte-bfddee04-0cba-4c16-9263-13a2695776ab" acquired by "delete_volume" :: waited 0.025s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:15:33 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[517f30ca-13f3-4ff3-b9db-e43b1bf933d8]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:15:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-759d48be-1fa3-4d04-a35a-171535ba4e88 tempest-VolumesNegativeTest-891542220 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bfddee04-0cba-4c16-9263-13a2695776ab {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:33 devstack sudo[96507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bfddee04-0cba-4c16-9263-13a2695776ab Jul 10 18:15:33 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:34 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-759d48be-1fa3-4d04-a35a-171535ba4e88 tempest-VolumesNegativeTest-891542220 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bfddee04-0cba-4c16-9263-13a2695776ab" returned: 0 in 1.052s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-759d48be-1fa3-4d04-a35a-171535ba4e88 tempest-VolumesNegativeTest-891542220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bfddee04-0cba-4c16-9263-13a2695776ab {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:34 devstack sudo[96513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bfddee04-0cba-4c16-9263-13a2695776ab Jul 10 18:15:34 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:35 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-759d48be-1fa3-4d04-a35a-171535ba4e88 tempest-VolumesNegativeTest-891542220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bfddee04-0cba-4c16-9263-13a2695776ab" returned: 0 in 0.748s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:35 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-759d48be-1fa3-4d04-a35a-171535ba4e88 tempest-VolumesNegativeTest-891542220 None] Lock "cinder-quobyte-bfddee04-0cba-4c16-9263-13a2695776ab" released by "delete_volume" :: held 1.856s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:15:35 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-759d48be-1fa3-4d04-a35a-171535ba4e88 tempest-VolumesNegativeTest-891542220 None] Created reservations ['02bb95a0-e989-49da-ae3e-a7e6d67e6393', '706b9b39-5f20-4800-bf74-e9ca8698fe63', '1cd5730a-2e3e-44f0-9e7e-46522fb77223', '2b4c9540-795a-4db1-b927-2efed801c6c3'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:15:35 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-14a8b66c-081d-4a81-9336-552899f6db80 req-4064b81f-716a-40a4-9c57-0122d326230a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Terminate volume connection completed successfully. Jul 10 18:15:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-14a8b66c-081d-4a81-9336-552899f6db80 req-4064b81f-716a-40a4-9c57-0122d326230a tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Deleting attachment b8b39e79-7980-4d4f-ae4f-2e1b8e1051fa. {{(pid=87399) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 18:15:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-759d48be-1fa3-4d04-a35a-171535ba4e88 tempest-VolumesNegativeTest-891542220 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:15:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-759d48be-1fa3-4d04-a35a-171535ba4e88 tempest-VolumesNegativeTest-891542220 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:15:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-759d48be-1fa3-4d04-a35a-171535ba4e88 tempest-VolumesNegativeTest-891542220 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:15:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-759d48be-1fa3-4d04-a35a-171535ba4e88 tempest-VolumesNegativeTest-891542220 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:15:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-759d48be-1fa3-4d04-a35a-171535ba4e88 tempest-VolumesNegativeTest-891542220 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:15:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-759d48be-1fa3-4d04-a35a-171535ba4e88 tempest-VolumesNegativeTest-891542220 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:35 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:15:35 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:36 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-759d48be-1fa3-4d04-a35a-171535ba4e88 tempest-VolumesNegativeTest-891542220 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.727s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:36 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-759d48be-1fa3-4d04-a35a-171535ba4e88 tempest-VolumesNegativeTest-891542220 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:15:36 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-759d48be-1fa3-4d04-a35a-171535ba4e88 tempest-VolumesNegativeTest-891542220 None] Deleted volume successfully. Jul 10 18:15:36 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-759d48be-1fa3-4d04-a35a-171535ba4e88 tempest-VolumesNegativeTest-891542220 None] Lock "cinder-bfddee04-0cba-4c16-9263-13a2695776ab-delete_volume" released by "delete_volume" :: held 2.905s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:15:36 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:15:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] Flow 'volume_create_manager' (9c996099-4b9b-49e6-a6c9-7244727851f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:15:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef19ee8b-eb86-4866-b14f-42eb9c5d7e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef19ee8b-eb86-4866-b14f-42eb9c5d7e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1518849352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b7ac7f9-e0dc-455d-986c-1f4ccffa200d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57876903c7f34128aaf048ba448d208c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:15:37Z,use_quota=True,user_id='891be13a52b14a4cb9e0e84b11446b51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fefb7436-23f8-4a66-b829-c4eaef022a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fefb7436-23f8-4a66-b829-c4eaef022a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4da081ef-c09d-4341-afa6-8b9b7e475e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4da081ef-c09d-4341-afa6-8b9b7e475e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b7ac7f9-e0dc-455d-986c-1f4ccffa200d', 'volume_name': 'volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d434272-2f24-4794-bf41-b51b4af2c983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d434272-2f24-4794-bf41-b51b4af2c983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a66b7f32-df32-4176-9118-464c9b91bc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:36 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] Volume 4b7ac7f9-e0dc-455d-986c-1f4ccffa200d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d', 'volume_size': 1} Jul 10 18:15:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:15:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:15:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1518849352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b7ac7f9-e0dc-455d-986c-1f4ccffa200d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57876903c7f34128aaf048ba448d208c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:15:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:15:37Z,use_quota=True,user_id='891be13a52b14a4cb9e0e84b11446b51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:15:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] Creating volume 4b7ac7f9-e0dc-455d-986c-1f4ccffa200d {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:15:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:15:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:15:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:15:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:15:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:15:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:15:36 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:15:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:36 devstack sudo[96550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d 1073741824 Jul 10 18:15:36 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:37 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d 1073741824" returned: 0 in 0.870s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:37 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cda9f0c1-fc2e-4055-817d-d9b7428f6a4d tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Acquiring lock "cinder-d26eaac3-2154-4e5a-b2ad-152c27ee7622-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:15:37 devstack sudo[96556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d Jul 10 18:15:37 devstack sudo[96556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:37 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cda9f0c1-fc2e-4055-817d-d9b7428f6a4d tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Lock "cinder-d26eaac3-2154-4e5a-b2ad-152c27ee7622-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:15:37 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cda9f0c1-fc2e-4055-817d-d9b7428f6a4d tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Acquiring lock "cinder-quobyte-d26eaac3-2154-4e5a-b2ad-152c27ee7622" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:15:37 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cda9f0c1-fc2e-4055-817d-d9b7428f6a4d tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Lock "cinder-quobyte-d26eaac3-2154-4e5a-b2ad-152c27ee7622" acquired by "delete_volume" :: waited 0.015s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:15:37 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[b458b2e3-a34b-4bb0-8f4a-20deaa99146f]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:15:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cda9f0c1-fc2e-4055-817d-d9b7428f6a4d tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d26eaac3-2154-4e5a-b2ad-152c27ee7622 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:38 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d26eaac3-2154-4e5a-b2ad-152c27ee7622 Jul 10 18:15:38 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] Flow 'volume_create_manager' (f6a92944-0829-49b3-82a3-d209a2475fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f71ee9dc-bc84-4fc3-bfa3-b496b0799c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f71ee9dc-bc84-4fc3-bfa3-b496b0799c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-662599311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d380b23e-54a0-4310-ab3a-833b39a04684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ee7f8897aef4ea28ba3c0f04ee30e39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:15:38Z,use_quota=True,user_id='ef92eaf3ea4c4707a2831ccc915bd659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c30efca2-4345-4cf4-843e-95950758e496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c30efca2-4345-4cf4-843e-95950758e496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d716634b-e321-4589-b950-4fe85caaa2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d716634b-e321-4589-b950-4fe85caaa2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd380b23e-54a0-4310-ab3a-833b39a04684', 'volume_name': 'volume-d380b23e-54a0-4310-ab3a-833b39a04684', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb82df4-2cba-4ff8-9d58-2eced27b4c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:38 devstack sudo[96556]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb82df4-2cba-4ff8-9d58-2eced27b4c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a743da83-6571-4f42-85b7-affaa9c96e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:38 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] Volume d380b23e-54a0-4310-ab3a-833b39a04684: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d380b23e-54a0-4310-ab3a-833b39a04684', 'volume_size': 1} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d" returned: 0 in 0.832s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.753s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-662599311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d380b23e-54a0-4310-ab3a-833b39a04684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ee7f8897aef4ea28ba3c0f04ee30e39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:15:38Z,use_quota=True,user_id='ef92eaf3ea4c4707a2831ccc915bd659',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] Creating volume d380b23e-54a0-4310-ab3a-833b39a04684 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:15:38 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:38 devstack sudo[96563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684 1073741824 Jul 10 18:15:38 devstack sudo[96563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a66b7f32-df32-4176-9118-464c9b91bc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e613cb-04c7-43f6-bc02-5159d2d67993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:38 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] Volume volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d (4b7ac7f9-e0dc-455d-986c-1f4ccffa200d): created successfully Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4e613cb-04c7-43f6-bc02-5159d2d67993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] Flow 'volume_create_manager' (9c996099-4b9b-49e6-a6c9-7244727851f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:15:38 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-1e3bd37c-5524-4ae7-a5ce-162dbe3b0e2c tempest-SnapshotMetadataTestJSON-441418533 None] Created volume successfully. Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] Flow 'volume_create_manager' (a0ed9b2d-6968-4a10-a8a8-2c328d85acf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d06bffd-ddd0-4816-937e-2531887eb8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d06bffd-ddd0-4816-937e-2531887eb8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-24260713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=656e91ea-cf57-4638-b996-6fc70bc2ce8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6544c1f8de84484948a0ad04f56400d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:15:39Z,use_quota=True,user_id='d509c372a958424c92a028fb1123dad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46426dcf-bfb1-4c74-89b8-ff1032101337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46426dcf-bfb1-4c74-89b8-ff1032101337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (782bc30b-bf13-4879-b5f1-49abd5581ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (782bc30b-bf13-4879-b5f1-49abd5581ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '656e91ea-cf57-4638-b996-6fc70bc2ce8a', 'volume_name': 'volume-656e91ea-cf57-4638-b996-6fc70bc2ce8a', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2511ae6-1ba6-4eb1-802f-b9b47ca62a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2511ae6-1ba6-4eb1-802f-b9b47ca62a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1733676e-5e39-4828-8a9d-bf41c8c2a8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:38 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] Volume 656e91ea-cf57-4638-b996-6fc70bc2ce8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-656e91ea-cf57-4638-b996-6fc70bc2ce8a', 'volume_size': 1} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:15:38 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cda9f0c1-fc2e-4055-817d-d9b7428f6a4d tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d26eaac3-2154-4e5a-b2ad-152c27ee7622" returned: 0 in 1.059s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cda9f0c1-fc2e-4055-817d-d9b7428f6a4d tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d26eaac3-2154-4e5a-b2ad-152c27ee7622 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:38 devstack sudo[96568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d26eaac3-2154-4e5a-b2ad-152c27ee7622 Jul 10 18:15:38 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-81026351-67e2-413f-b835-0e691a2c15cf tempest-SnapshotMetadataTestJSON-441418533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:15:39 devstack sudo[96563]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684 1073741824" returned: 0 in 0.967s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:39 devstack sudo[96576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684 Jul 10 18:15:39 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:39 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cda9f0c1-fc2e-4055-817d-d9b7428f6a4d tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d26eaac3-2154-4e5a-b2ad-152c27ee7622" returned: 0 in 0.781s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:39 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cda9f0c1-fc2e-4055-817d-d9b7428f6a4d tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Lock "cinder-quobyte-d26eaac3-2154-4e5a-b2ad-152c27ee7622" released by "delete_volume" :: held 1.892s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:15:39 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-cda9f0c1-fc2e-4055-817d-d9b7428f6a4d tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Created reservations ['7b0264d7-60be-4553-b938-ebb7b1e4da9c', 'dcb09d00-0c41-43e6-a538-8db5fa34f8eb', '986bb56d-caf8-423c-8df2-ba55d5418834', 'dfeed770-d23d-4aba-b5e0-033021a67768'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:15:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-cda9f0c1-fc2e-4055-817d-d9b7428f6a4d tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:15:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-cda9f0c1-fc2e-4055-817d-d9b7428f6a4d tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:15:39 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-cda9f0c1-fc2e-4055-817d-d9b7428f6a4d tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:15:39 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-cda9f0c1-fc2e-4055-817d-d9b7428f6a4d tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:15:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-cda9f0c1-fc2e-4055-817d-d9b7428f6a4d tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:15:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cda9f0c1-fc2e-4055-817d-d9b7428f6a4d tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:39 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:15:39 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:40 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684" returned: 0 in 0.730s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:40 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:15:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:15:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.430s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:15:40 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-24260713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=656e91ea-cf57-4638-b996-6fc70bc2ce8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6544c1f8de84484948a0ad04f56400d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:15:39Z,use_quota=True,user_id='d509c372a958424c92a028fb1123dad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:15:40 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] Creating volume 656e91ea-cf57-4638-b996-6fc70bc2ce8a {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:15:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:15:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:15:40 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:15:40 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:15:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:15:40 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:15:40 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:15:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-656e91ea-cf57-4638-b996-6fc70bc2ce8a 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a743da83-6571-4f42-85b7-affaa9c96e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d380b23e-54a0-4310-ab3a-833b39a04684', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a51c21c-e62e-4d55-9cd5-3c4ca17ecb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:40 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-656e91ea-cf57-4638-b996-6fc70bc2ce8a 1073741824 Jul 10 18:15:40 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:40 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] Volume volume-d380b23e-54a0-4310-ab3a-833b39a04684 (d380b23e-54a0-4310-ab3a-833b39a04684): created successfully Jul 10 18:15:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a51c21c-e62e-4d55-9cd5-3c4ca17ecb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] Flow 'volume_create_manager' (f6a92944-0829-49b3-82a3-d209a2475fe3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:15:40 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-bfe6dbc5-691f-4aa4-a1e1-d45ff8729024 tempest-VolumesSnapshotListTestJSON-1919428096 None] Created volume successfully. Jul 10 18:15:40 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cda9f0c1-fc2e-4055-817d-d9b7428f6a4d tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.716s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:40 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-cda9f0c1-fc2e-4055-817d-d9b7428f6a4d tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:15:40 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-cda9f0c1-fc2e-4055-817d-d9b7428f6a4d tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Deleted volume successfully. Jul 10 18:15:40 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cda9f0c1-fc2e-4055-817d-d9b7428f6a4d tempest-TestServerVolumeAttachScenarioOldVersion-1760748048 None] Lock "cinder-d26eaac3-2154-4e5a-b2ad-152c27ee7622-delete_volume" released by "delete_volume" :: held 2.811s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:15:41 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-656e91ea-cf57-4638-b996-6fc70bc2ce8a 1073741824" returned: 0 in 0.915s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-656e91ea-cf57-4638-b996-6fc70bc2ce8a {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:41 devstack sudo[96589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-656e91ea-cf57-4638-b996-6fc70bc2ce8a Jul 10 18:15:41 devstack sudo[96589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2e3560b0-ae83-4dfe-b08b-59b40a191661 tempest-VolumesSnapshotListTestJSON-1919428096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:15:42 devstack sudo[96589]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-656e91ea-cf57-4638-b996-6fc70bc2ce8a" returned: 0 in 0.760s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:42 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:15:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:15:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-81026351-67e2-413f-b835-0e691a2c15cf tempest-SnapshotMetadataTestJSON-441418533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.916s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:15:42 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-81026351-67e2-413f-b835-0e691a2c15cf tempest-SnapshotMetadataTestJSON-441418533 None] Creating offline snapshot 1dec3222-79fc-40bc-8ea7-5441469c15bc of volume 4b7ac7f9-e0dc-455d-986c-1f4ccffa200d {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:15:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1733676e-5e39-4828-8a9d-bf41c8c2a8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-656e91ea-cf57-4638-b996-6fc70bc2ce8a', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2549ee55-6222-4dff-8193-7bacc45d074e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:42 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf013a61-4ac8-476f-895a-2a9442e99f44]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:15:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-81026351-67e2-413f-b835-0e691a2c15cf tempest-SnapshotMetadataTestJSON-441418533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:42 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] Volume volume-656e91ea-cf57-4638-b996-6fc70bc2ce8a (656e91ea-cf57-4638-b996-6fc70bc2ce8a): created successfully Jul 10 18:15:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2549ee55-6222-4dff-8193-7bacc45d074e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] Flow 'volume_create_manager' (a0ed9b2d-6968-4a10-a8a8-2c328d85acf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:15:42 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-b41d8853-acb5-40c0-915c-38f572f21c3d tempest-AttachVolumeTestJSON-309313673 None] Created volume successfully. Jul 10 18:15:42 devstack sudo[96608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d Jul 10 18:15:42 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:42 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-81026351-67e2-413f-b835-0e691a2c15cf tempest-SnapshotMetadataTestJSON-441418533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d" returned: 0 in 0.886s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-81026351-67e2-413f-b835-0e691a2c15cf tempest-SnapshotMetadataTestJSON-441418533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d.1dec3222-79fc-40bc-8ea7-5441469c15bc 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:43 devstack sudo[96620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d.1dec3222-79fc-40bc-8ea7-5441469c15bc 1G Jul 10 18:15:43 devstack sudo[96620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:43 devstack sudo[96620]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-81026351-67e2-413f-b835-0e691a2c15cf tempest-SnapshotMetadataTestJSON-441418533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d.1dec3222-79fc-40bc-8ea7-5441469c15bc 1G" returned: 0 in 0.873s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-81026351-67e2-413f-b835-0e691a2c15cf tempest-SnapshotMetadataTestJSON-441418533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d.1dec3222-79fc-40bc-8ea7-5441469c15bc {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:43 devstack sudo[96631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d.1dec3222-79fc-40bc-8ea7-5441469c15bc Jul 10 18:15:43 devstack sudo[96631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:44 devstack sudo[96631]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-81026351-67e2-413f-b835-0e691a2c15cf tempest-SnapshotMetadataTestJSON-441418533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d.1dec3222-79fc-40bc-8ea7-5441469c15bc" returned: 0 in 0.776s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:44 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-81026351-67e2-413f-b835-0e691a2c15cf tempest-SnapshotMetadataTestJSON-441418533 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d.1dec3222-79fc-40bc-8ea7-5441469c15bc is being set with open permissions: ugo+rw Jul 10 18:15:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-81026351-67e2-413f-b835-0e691a2c15cf tempest-SnapshotMetadataTestJSON-441418533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d.1dec3222-79fc-40bc-8ea7-5441469c15bc {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:44 devstack sudo[96673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d.1dec3222-79fc-40bc-8ea7-5441469c15bc Jul 10 18:15:44 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:45 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-81026351-67e2-413f-b835-0e691a2c15cf tempest-SnapshotMetadataTestJSON-441418533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d.1dec3222-79fc-40bc-8ea7-5441469c15bc" returned: 0 in 0.671s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-81026351-67e2-413f-b835-0e691a2c15cf tempest-SnapshotMetadataTestJSON-441418533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:45 devstack sudo[96676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d.info Jul 10 18:15:45 devstack sudo[96676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:46 devstack sudo[96676]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-81026351-67e2-413f-b835-0e691a2c15cf tempest-SnapshotMetadataTestJSON-441418533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d.info" returned: 0 in 0.684s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:46 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-81026351-67e2-413f-b835-0e691a2c15cf tempest-SnapshotMetadataTestJSON-441418533 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d.info is being set with open permissions: ugo+rw Jul 10 18:15:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-81026351-67e2-413f-b835-0e691a2c15cf tempest-SnapshotMetadataTestJSON-441418533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:46 devstack sudo[96687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d.info Jul 10 18:15:46 devstack sudo[96687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-4d78a354-9aa8-4a80-89fc-5b1c3f3d6d74 req-58fe7dce-4bc9-44b2-bb6a-2dc216929078 tempest-AttachVolumeTestJSON-309313673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:15:46 devstack sudo[96687]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-81026351-67e2-413f-b835-0e691a2c15cf tempest-SnapshotMetadataTestJSON-441418533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d.info" returned: 0 in 0.662s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-81026351-67e2-413f-b835-0e691a2c15cf tempest-SnapshotMetadataTestJSON-441418533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.664s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:15:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2e3560b0-ae83-4dfe-b08b-59b40a191661 tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.933s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:15:46 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-2e3560b0-ae83-4dfe-b08b-59b40a191661 tempest-VolumesSnapshotListTestJSON-1919428096 None] Creating offline snapshot a73590b8-a5e8-4a3f-80e8-73b0d04bdd97 of volume d380b23e-54a0-4310-ab3a-833b39a04684 {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:15:46 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabaeaa1-6c92-406e-8e92-8c041cfbe6d8]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:15:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2e3560b0-ae83-4dfe-b08b-59b40a191661 tempest-VolumesSnapshotListTestJSON-1919428096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:46 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-81026351-67e2-413f-b835-0e691a2c15cf tempest-SnapshotMetadataTestJSON-441418533 None] Create snapshot completed successfully Jul 10 18:15:46 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684 Jul 10 18:15:46 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:47 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2e3560b0-ae83-4dfe-b08b-59b40a191661 tempest-VolumesSnapshotListTestJSON-1919428096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684" returned: 0 in 0.825s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2e3560b0-ae83-4dfe-b08b-59b40a191661 tempest-VolumesSnapshotListTestJSON-1919428096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a73590b8-a5e8-4a3f-80e8-73b0d04bdd97 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:47 devstack sudo[96698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a73590b8-a5e8-4a3f-80e8-73b0d04bdd97 1G Jul 10 18:15:47 devstack sudo[96698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5914642f-7802-4972-98bc-ccc151d583a0 tempest-SnapshotMetadataTestJSON-441418533 None] Acquiring lock "cinder-1dec3222-79fc-40bc-8ea7-5441469c15bc-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:15:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5914642f-7802-4972-98bc-ccc151d583a0 tempest-SnapshotMetadataTestJSON-441418533 None] Lock "cinder-1dec3222-79fc-40bc-8ea7-5441469c15bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:15:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5914642f-7802-4972-98bc-ccc151d583a0 tempest-SnapshotMetadataTestJSON-441418533 None] Acquiring lock "cinder-quobyte-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:15:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5914642f-7802-4972-98bc-ccc151d583a0 tempest-SnapshotMetadataTestJSON-441418533 None] Lock "cinder-quobyte-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:15:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5914642f-7802-4972-98bc-ccc151d583a0 tempest-SnapshotMetadataTestJSON-441418533 None] Acquiring lock "cinder-quobyte-1dec3222-79fc-40bc-8ea7-5441469c15bc" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:15:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5914642f-7802-4972-98bc-ccc151d583a0 tempest-SnapshotMetadataTestJSON-441418533 None] Lock "cinder-quobyte-1dec3222-79fc-40bc-8ea7-5441469c15bc" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:15:48 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-5914642f-7802-4972-98bc-ccc151d583a0 tempest-SnapshotMetadataTestJSON-441418533 None] Deleting offline snapshot 1dec3222-79fc-40bc-8ea7-5441469c15bc of volume 4b7ac7f9-e0dc-455d-986c-1f4ccffa200d {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:15:48 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-5914642f-7802-4972-98bc-ccc151d583a0 tempest-SnapshotMetadataTestJSON-441418533 None] snapshot_file for this snap is: volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d.1dec3222-79fc-40bc-8ea7-5441469c15bc {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:15:48 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af00cf2-0336-4d98-a5cb-3300a5268975]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:15:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5914642f-7802-4972-98bc-ccc151d583a0 tempest-SnapshotMetadataTestJSON-441418533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d.1dec3222-79fc-40bc-8ea7-5441469c15bc {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:48 devstack sudo[96703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d.1dec3222-79fc-40bc-8ea7-5441469c15bc Jul 10 18:15:48 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:48 devstack sudo[96698]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2e3560b0-ae83-4dfe-b08b-59b40a191661 tempest-VolumesSnapshotListTestJSON-1919428096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a73590b8-a5e8-4a3f-80e8-73b0d04bdd97 1G" returned: 0 in 0.981s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2e3560b0-ae83-4dfe-b08b-59b40a191661 tempest-VolumesSnapshotListTestJSON-1919428096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d380b23e-54a0-4310-ab3a-833b39a04684 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a73590b8-a5e8-4a3f-80e8-73b0d04bdd97 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:48 devstack sudo[96705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d380b23e-54a0-4310-ab3a-833b39a04684 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a73590b8-a5e8-4a3f-80e8-73b0d04bdd97 Jul 10 18:15:48 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:49 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5914642f-7802-4972-98bc-ccc151d583a0 tempest-SnapshotMetadataTestJSON-441418533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d.1dec3222-79fc-40bc-8ea7-5441469c15bc" returned: 0 in 0.890s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:49 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-5914642f-7802-4972-98bc-ccc151d583a0 tempest-SnapshotMetadataTestJSON-441418533 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:15:49 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2e3560b0-ae83-4dfe-b08b-59b40a191661 tempest-VolumesSnapshotListTestJSON-1919428096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d380b23e-54a0-4310-ab3a-833b39a04684 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a73590b8-a5e8-4a3f-80e8-73b0d04bdd97" returned: 0 in 0.757s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:49 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-2e3560b0-ae83-4dfe-b08b-59b40a191661 tempest-VolumesSnapshotListTestJSON-1919428096 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a73590b8-a5e8-4a3f-80e8-73b0d04bdd97 is being set with open permissions: ugo+rw Jul 10 18:15:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2e3560b0-ae83-4dfe-b08b-59b40a191661 tempest-VolumesSnapshotListTestJSON-1919428096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a73590b8-a5e8-4a3f-80e8-73b0d04bdd97 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:49 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3f7bfc-0e35-4a9f-bac7-936b07fc23e7]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:15:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5914642f-7802-4972-98bc-ccc151d583a0 tempest-SnapshotMetadataTestJSON-441418533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:49 devstack sudo[96713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a73590b8-a5e8-4a3f-80e8-73b0d04bdd97 Jul 10 18:15:49 devstack sudo[96713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:49 devstack sudo[96714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d Jul 10 18:15:49 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:50 devstack sudo[96713]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2e3560b0-ae83-4dfe-b08b-59b40a191661 tempest-VolumesSnapshotListTestJSON-1919428096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a73590b8-a5e8-4a3f-80e8-73b0d04bdd97" returned: 0 in 0.694s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:50 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:UPDATE=60,cinder:SELECT=58,cinder:DELETE=3,cinder:INSERT=20 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:15:50 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=67,cinder:INSERT=22,cinder:UPDATE=69,cinder:DELETE=10 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:15:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2e3560b0-ae83-4dfe-b08b-59b40a191661 tempest-VolumesSnapshotListTestJSON-1919428096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:50 devstack sudo[96721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.info Jul 10 18:15:50 devstack sudo[96721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:50 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5914642f-7802-4972-98bc-ccc151d583a0 tempest-SnapshotMetadataTestJSON-441418533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d" returned: 0 in 0.875s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5914642f-7802-4972-98bc-ccc151d583a0 tempest-SnapshotMetadataTestJSON-441418533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d.1dec3222-79fc-40bc-8ea7-5441469c15bc {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:50 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d.1dec3222-79fc-40bc-8ea7-5441469c15bc Jul 10 18:15:50 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:50 devstack sudo[96721]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2e3560b0-ae83-4dfe-b08b-59b40a191661 tempest-VolumesSnapshotListTestJSON-1919428096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.info" returned: 0 in 0.760s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:50 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-2e3560b0-ae83-4dfe-b08b-59b40a191661 tempest-VolumesSnapshotListTestJSON-1919428096 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.info is being set with open permissions: ugo+rw Jul 10 18:15:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2e3560b0-ae83-4dfe-b08b-59b40a191661 tempest-VolumesSnapshotListTestJSON-1919428096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:50 devstack sudo[96729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.info Jul 10 18:15:50 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:51 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5914642f-7802-4972-98bc-ccc151d583a0 tempest-SnapshotMetadataTestJSON-441418533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d.1dec3222-79fc-40bc-8ea7-5441469c15bc" returned: 0 in 0.828s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5914642f-7802-4972-98bc-ccc151d583a0 tempest-SnapshotMetadataTestJSON-441418533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d.1dec3222-79fc-40bc-8ea7-5441469c15bc {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:51 devstack sudo[96732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d.1dec3222-79fc-40bc-8ea7-5441469c15bc Jul 10 18:15:51 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:51 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2e3560b0-ae83-4dfe-b08b-59b40a191661 tempest-VolumesSnapshotListTestJSON-1919428096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.info" returned: 0 in 0.739s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2e3560b0-ae83-4dfe-b08b-59b40a191661 tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.879s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:15:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-4d78a354-9aa8-4a80-89fc-5b1c3f3d6d74 req-58fe7dce-4bc9-44b2-bb6a-2dc216929078 tempest-AttachVolumeTestJSON-309313673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.403s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:15:51 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[63648015-db7e-4a25-b0b3-a4d6e6e76199]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:15:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-4d78a354-9aa8-4a80-89fc-5b1c3f3d6d74 req-58fe7dce-4bc9-44b2-bb6a-2dc216929078 tempest-AttachVolumeTestJSON-309313673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-656e91ea-cf57-4638-b996-6fc70bc2ce8a {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:51 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-2e3560b0-ae83-4dfe-b08b-59b40a191661 tempest-VolumesSnapshotListTestJSON-1919428096 None] Create snapshot completed successfully Jul 10 18:15:51 devstack sudo[96735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-656e91ea-cf57-4638-b996-6fc70bc2ce8a Jul 10 18:15:51 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:51 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5914642f-7802-4972-98bc-ccc151d583a0 tempest-SnapshotMetadataTestJSON-441418533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d.1dec3222-79fc-40bc-8ea7-5441469c15bc" returned: 0 in 0.821s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:51 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5914642f-7802-4972-98bc-ccc151d583a0 tempest-SnapshotMetadataTestJSON-441418533 None] Lock "cinder-quobyte-1dec3222-79fc-40bc-8ea7-5441469c15bc" released by "_delete_snapshot" :: held 3.563s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:15:51 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5914642f-7802-4972-98bc-ccc151d583a0 tempest-SnapshotMetadataTestJSON-441418533 None] Lock "cinder-quobyte-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d" released by "delete_snapshot" :: held 3.600s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:15:52 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-5914642f-7802-4972-98bc-ccc151d583a0 tempest-SnapshotMetadataTestJSON-441418533 None] Created reservations ['cad637ff-37f0-40c9-b657-93435dea1b30', '35795eec-c739-465d-b2bb-05c198dcffd9', '99b74b97-88b2-466a-be22-9b88fa99e860', '4587bb1a-40dd-4645-8308-34b0e451be61'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:15:52 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-5914642f-7802-4972-98bc-ccc151d583a0 tempest-SnapshotMetadataTestJSON-441418533 None] Delete snapshot completed successfully. Jul 10 18:15:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5914642f-7802-4972-98bc-ccc151d583a0 tempest-SnapshotMetadataTestJSON-441418533 None] Lock "cinder-1dec3222-79fc-40bc-8ea7-5441469c15bc-delete_snapshot" released by "delete_snapshot" :: held 3.756s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:15:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1913d7a9-1a66-4770-9839-c1196a205c54 tempest-VolumesSnapshotListTestJSON-1919428096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:15:52 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-4d78a354-9aa8-4a80-89fc-5b1c3f3d6d74 req-58fe7dce-4bc9-44b2-bb6a-2dc216929078 tempest-AttachVolumeTestJSON-309313673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-656e91ea-cf57-4638-b996-6fc70bc2ce8a" returned: 0 in 0.900s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-4d78a354-9aa8-4a80-89fc-5b1c3f3d6d74 req-58fe7dce-4bc9-44b2-bb6a-2dc216929078 tempest-AttachVolumeTestJSON-309313673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.929s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:15:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1913d7a9-1a66-4770-9839-c1196a205c54 tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.042s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:15:52 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-1913d7a9-1a66-4770-9839-c1196a205c54 tempest-VolumesSnapshotListTestJSON-1919428096 None] Creating offline snapshot 24eb18c7-d875-42ff-8eda-233e38cd2624 of volume d380b23e-54a0-4310-ab3a-833b39a04684 {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:15:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-068b1795-5cf6-4523-b45b-c6b395c7dae8 tempest-SnapshotMetadataTestJSON-441418533 None] Acquiring lock "cinder-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:15:52 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a0165b-1cde-4c56-9fd1-f70dae12554b]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:15:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1913d7a9-1a66-4770-9839-c1196a205c54 tempest-VolumesSnapshotListTestJSON-1919428096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a73590b8-a5e8-4a3f-80e8-73b0d04bdd97 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-068b1795-5cf6-4523-b45b-c6b395c7dae8 tempest-SnapshotMetadataTestJSON-441418533 None] Lock "cinder-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:15:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-4d78a354-9aa8-4a80-89fc-5b1c3f3d6d74 req-58fe7dce-4bc9-44b2-bb6a-2dc216929078 tempest-AttachVolumeTestJSON-309313673 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd', 'name': 'volume-656e91ea-cf57-4638-b996-6fc70bc2ce8a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '742b18b7-db54-42ea-81d4-d980919798b5', 'enforce_multipath': True} {{(pid=87399) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 18:15:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-068b1795-5cf6-4523-b45b-c6b395c7dae8 tempest-SnapshotMetadataTestJSON-441418533 None] Acquiring lock "cinder-quobyte-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:15:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-068b1795-5cf6-4523-b45b-c6b395c7dae8 tempest-SnapshotMetadataTestJSON-441418533 None] Lock "cinder-quobyte-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d" acquired by "delete_volume" :: waited 0.023s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:15:52 devstack sudo[96743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a73590b8-a5e8-4a3f-80e8-73b0d04bdd97 Jul 10 18:15:52 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:52 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-4d78a354-9aa8-4a80-89fc-5b1c3f3d6d74 req-58fe7dce-4bc9-44b2-bb6a-2dc216929078 tempest-AttachVolumeTestJSON-309313673 None] attachment_update completed successfully. Jul 10 18:15:52 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68f84e3-c8bf-4997-bff1-7e8eb8e007c4]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:15:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-068b1795-5cf6-4523-b45b-c6b395c7dae8 tempest-SnapshotMetadataTestJSON-441418533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:52 devstack sudo[96745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d Jul 10 18:15:52 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:53 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1913d7a9-1a66-4770-9839-c1196a205c54 tempest-VolumesSnapshotListTestJSON-1919428096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a73590b8-a5e8-4a3f-80e8-73b0d04bdd97" returned: 0 in 0.930s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:53 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-1913d7a9-1a66-4770-9839-c1196a205c54 tempest-VolumesSnapshotListTestJSON-1919428096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d380b23e-54a0-4310-ab3a-833b39a04684(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:15:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1913d7a9-1a66-4770-9839-c1196a205c54 tempest-VolumesSnapshotListTestJSON-1919428096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a73590b8-a5e8-4a3f-80e8-73b0d04bdd97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.24eb18c7-d875-42ff-8eda-233e38cd2624 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:53 devstack sudo[96819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a73590b8-a5e8-4a3f-80e8-73b0d04bdd97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.24eb18c7-d875-42ff-8eda-233e38cd2624 1G Jul 10 18:15:53 devstack sudo[96819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:53 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-068b1795-5cf6-4523-b45b-c6b395c7dae8 tempest-SnapshotMetadataTestJSON-441418533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d" returned: 0 in 0.920s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-068b1795-5cf6-4523-b45b-c6b395c7dae8 tempest-SnapshotMetadataTestJSON-441418533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:53 devstack sudo[96822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d Jul 10 18:15:53 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:54 devstack sudo[96819]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1913d7a9-1a66-4770-9839-c1196a205c54 tempest-VolumesSnapshotListTestJSON-1919428096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a73590b8-a5e8-4a3f-80e8-73b0d04bdd97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.24eb18c7-d875-42ff-8eda-233e38cd2624 1G" returned: 0 in 1.015s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1913d7a9-1a66-4770-9839-c1196a205c54 tempest-VolumesSnapshotListTestJSON-1919428096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d380b23e-54a0-4310-ab3a-833b39a04684.a73590b8-a5e8-4a3f-80e8-73b0d04bdd97 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.24eb18c7-d875-42ff-8eda-233e38cd2624 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:54 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-068b1795-5cf6-4523-b45b-c6b395c7dae8 tempest-SnapshotMetadataTestJSON-441418533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d" returned: 0 in 0.883s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:54 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d380b23e-54a0-4310-ab3a-833b39a04684.a73590b8-a5e8-4a3f-80e8-73b0d04bdd97 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.24eb18c7-d875-42ff-8eda-233e38cd2624 Jul 10 18:15:54 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:54 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-068b1795-5cf6-4523-b45b-c6b395c7dae8 tempest-SnapshotMetadataTestJSON-441418533 None] Lock "cinder-quobyte-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d" released by "delete_volume" :: held 1.885s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:15:54 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-068b1795-5cf6-4523-b45b-c6b395c7dae8 tempest-SnapshotMetadataTestJSON-441418533 None] Created reservations ['368aa506-c96f-4e70-98ae-3092cec0a285', 'd4b93732-d6c2-4f49-8ab7-9881e046b239', 'cc202adf-f32a-4b0f-a5dc-80e5fa7f21b7', 'cd80a0d1-eccc-4916-80b2-292645cd3563'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:15:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-068b1795-5cf6-4523-b45b-c6b395c7dae8 tempest-SnapshotMetadataTestJSON-441418533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:15:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-068b1795-5cf6-4523-b45b-c6b395c7dae8 tempest-SnapshotMetadataTestJSON-441418533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:15:54 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-068b1795-5cf6-4523-b45b-c6b395c7dae8 tempest-SnapshotMetadataTestJSON-441418533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:15:54 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-068b1795-5cf6-4523-b45b-c6b395c7dae8 tempest-SnapshotMetadataTestJSON-441418533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:15:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-068b1795-5cf6-4523-b45b-c6b395c7dae8 tempest-SnapshotMetadataTestJSON-441418533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:15:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-068b1795-5cf6-4523-b45b-c6b395c7dae8 tempest-SnapshotMetadataTestJSON-441418533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:54 devstack sudo[97150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:15:54 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:55 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1913d7a9-1a66-4770-9839-c1196a205c54 tempest-VolumesSnapshotListTestJSON-1919428096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d380b23e-54a0-4310-ab3a-833b39a04684.a73590b8-a5e8-4a3f-80e8-73b0d04bdd97 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.24eb18c7-d875-42ff-8eda-233e38cd2624" returned: 0 in 1.051s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:55 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-1913d7a9-1a66-4770-9839-c1196a205c54 tempest-VolumesSnapshotListTestJSON-1919428096 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.24eb18c7-d875-42ff-8eda-233e38cd2624 is being set with open permissions: ugo+rw Jul 10 18:15:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1913d7a9-1a66-4770-9839-c1196a205c54 tempest-VolumesSnapshotListTestJSON-1919428096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.24eb18c7-d875-42ff-8eda-233e38cd2624 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:55 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:55 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.24eb18c7-d875-42ff-8eda-233e38cd2624 Jul 10 18:15:55 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-068b1795-5cf6-4523-b45b-c6b395c7dae8 tempest-SnapshotMetadataTestJSON-441418533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.917s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:55 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-068b1795-5cf6-4523-b45b-c6b395c7dae8 tempest-SnapshotMetadataTestJSON-441418533 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:15:55 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-068b1795-5cf6-4523-b45b-c6b395c7dae8 tempest-SnapshotMetadataTestJSON-441418533 None] Deleted volume successfully. Jul 10 18:15:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-068b1795-5cf6-4523-b45b-c6b395c7dae8 tempest-SnapshotMetadataTestJSON-441418533 None] Lock "cinder-4b7ac7f9-e0dc-455d-986c-1f4ccffa200d-delete_volume" released by "delete_volume" :: held 3.068s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:15:56 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1913d7a9-1a66-4770-9839-c1196a205c54 tempest-VolumesSnapshotListTestJSON-1919428096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.24eb18c7-d875-42ff-8eda-233e38cd2624" returned: 0 in 0.781s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1913d7a9-1a66-4770-9839-c1196a205c54 tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.925s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:15:56 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-1913d7a9-1a66-4770-9839-c1196a205c54 tempest-VolumesSnapshotListTestJSON-1919428096 None] Create snapshot completed successfully Jul 10 18:15:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1393fb51-8275-473a-bcfd-a36e656098df tempest-VolumesSnapshotListTestJSON-1919428096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:15:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1393fb51-8275-473a-bcfd-a36e656098df tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:15:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-1393fb51-8275-473a-bcfd-a36e656098df tempest-VolumesSnapshotListTestJSON-1919428096 None] Creating offline snapshot a760c365-3c02-4b2f-b1e7-f01a02673152 of volume d380b23e-54a0-4310-ab3a-833b39a04684 {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:15:57 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf27bfe-9b44-4165-81d7-6518f86c1a6d]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:15:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1393fb51-8275-473a-bcfd-a36e656098df tempest-VolumesSnapshotListTestJSON-1919428096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.24eb18c7-d875-42ff-8eda-233e38cd2624 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:57 devstack sudo[97163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.24eb18c7-d875-42ff-8eda-233e38cd2624 Jul 10 18:15:57 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:57 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:15:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:15:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:15:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:15:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:15:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:15:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:57 devstack sudo[97165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:15:57 devstack sudo[97165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:58 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1393fb51-8275-473a-bcfd-a36e656098df tempest-VolumesSnapshotListTestJSON-1919428096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.24eb18c7-d875-42ff-8eda-233e38cd2624" returned: 0 in 1.048s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-1393fb51-8275-473a-bcfd-a36e656098df tempest-VolumesSnapshotListTestJSON-1919428096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d380b23e-54a0-4310-ab3a-833b39a04684(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:15:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1393fb51-8275-473a-bcfd-a36e656098df tempest-VolumesSnapshotListTestJSON-1919428096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.24eb18c7-d875-42ff-8eda-233e38cd2624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a760c365-3c02-4b2f-b1e7-f01a02673152 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:58 devstack sudo[97170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.24eb18c7-d875-42ff-8eda-233e38cd2624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a760c365-3c02-4b2f-b1e7-f01a02673152 1G Jul 10 18:15:58 devstack sudo[97170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:15:58 devstack sudo[97165]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.028s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:58 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:15:58 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager._thread_info {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:15:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread count: 28 {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 18:15:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread info: [<_MainThread(MainThread, started 139757428633728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 18:15:58 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:15:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] Flow 'volume_create_manager' (7ae6877d-a310-4d77-9e87-bdad7de2fdaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:15:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a7599fb-e4ac-4c81-a6bd-a8dbd01dabeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a7599fb-e4ac-4c81-a6bd-a8dbd01dabeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-158104432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d378987-e3f8-410e-b700-b3a107ef3186,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6544c1f8de84484948a0ad04f56400d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:15:59Z,use_quota=True,user_id='d509c372a958424c92a028fb1123dad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a6c472-dc7a-48c7-987b-ac2872e3e451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a6c472-dc7a-48c7-987b-ac2872e3e451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d01cb56-95e9-4ac2-bdf1-23a118e2549a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d01cb56-95e9-4ac2-bdf1-23a118e2549a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d378987-e3f8-410e-b700-b3a107ef3186', 'volume_name': 'volume-8d378987-e3f8-410e-b700-b3a107ef3186', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c9702fd-ec2d-4313-ad11-1b980557525d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c9702fd-ec2d-4313-ad11-1b980557525d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:15:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (063df9d5-9c10-4375-b590-31e27d0062c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:15:59 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] Volume 8d378987-e3f8-410e-b700-b3a107ef3186: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d378987-e3f8-410e-b700-b3a107ef3186', 'volume_size': 1} Jul 10 18:15:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:15:59 devstack sudo[97170]: pam_unix(sudo:session): session closed for user root Jul 10 18:15:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1393fb51-8275-473a-bcfd-a36e656098df tempest-VolumesSnapshotListTestJSON-1919428096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.24eb18c7-d875-42ff-8eda-233e38cd2624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a760c365-3c02-4b2f-b1e7-f01a02673152 1G" returned: 0 in 1.172s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:15:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1393fb51-8275-473a-bcfd-a36e656098df tempest-VolumesSnapshotListTestJSON-1919428096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d380b23e-54a0-4310-ab3a-833b39a04684.24eb18c7-d875-42ff-8eda-233e38cd2624 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a760c365-3c02-4b2f-b1e7-f01a02673152 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:15:59 devstack sudo[97177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d380b23e-54a0-4310-ab3a-833b39a04684.24eb18c7-d875-42ff-8eda-233e38cd2624 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a760c365-3c02-4b2f-b1e7-f01a02673152 Jul 10 18:15:59 devstack sudo[97177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:00 devstack sudo[97177]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1393fb51-8275-473a-bcfd-a36e656098df tempest-VolumesSnapshotListTestJSON-1919428096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d380b23e-54a0-4310-ab3a-833b39a04684.24eb18c7-d875-42ff-8eda-233e38cd2624 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a760c365-3c02-4b2f-b1e7-f01a02673152" returned: 0 in 0.767s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:00 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-1393fb51-8275-473a-bcfd-a36e656098df tempest-VolumesSnapshotListTestJSON-1919428096 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a760c365-3c02-4b2f-b1e7-f01a02673152 is being set with open permissions: ugo+rw Jul 10 18:16:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1393fb51-8275-473a-bcfd-a36e656098df tempest-VolumesSnapshotListTestJSON-1919428096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a760c365-3c02-4b2f-b1e7-f01a02673152 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:00 devstack sudo[97188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a760c365-3c02-4b2f-b1e7-f01a02673152 Jul 10 18:16:00 devstack sudo[97188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:00 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:16:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] Flow 'volume_create_manager' (14357bff-209c-421c-bc81-6bca891e87b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:16:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b12f2b-df4c-40d2-9f67-6f4f43a729ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84b12f2b-df4c-40d2-9f67-6f4f43a729ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1955065605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=341953f1-cc38-4d42-80cf-7ca862694f83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90d1b5877411490abff36bb8898d6a8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:16:00Z,use_quota=True,user_id='31b33caa03d245a897d7858a2a80bff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d044996-fbc3-4530-815a-576ffea90740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d044996-fbc3-4530-815a-576ffea90740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98220fe0-5d97-42fd-bb50-32f4a1e04d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98220fe0-5d97-42fd-bb50-32f4a1e04d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '341953f1-cc38-4d42-80cf-7ca862694f83', 'volume_name': 'volume-341953f1-cc38-4d42-80cf-7ca862694f83', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad829d86-a081-485b-a3f7-6018f01743fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad829d86-a081-485b-a3f7-6018f01743fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a30916-581d-47f1-8c4e-766fee6c0558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:00 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] Volume 341953f1-cc38-4d42-80cf-7ca862694f83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-341953f1-cc38-4d42-80cf-7ca862694f83', 'volume_size': 1} Jul 10 18:16:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:16:00 devstack sudo[97188]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1393fb51-8275-473a-bcfd-a36e656098df tempest-VolumesSnapshotListTestJSON-1919428096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a760c365-3c02-4b2f-b1e7-f01a02673152" returned: 0 in 0.713s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1393fb51-8275-473a-bcfd-a36e656098df tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.836s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:16:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.658s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:16:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-158104432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d378987-e3f8-410e-b700-b3a107ef3186,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6544c1f8de84484948a0ad04f56400d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:15:59Z,use_quota=True,user_id='d509c372a958424c92a028fb1123dad1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:16:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] Creating volume 8d378987-e3f8-410e-b700-b3a107ef3186 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:16:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:16:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:16:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:16:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:16:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:16:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:16:00 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:16:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8d378987-e3f8-410e-b700-b3a107ef3186 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:00 devstack sudo[97191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8d378987-e3f8-410e-b700-b3a107ef3186 1073741824 Jul 10 18:16:00 devstack sudo[97191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:00 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-1393fb51-8275-473a-bcfd-a36e656098df tempest-VolumesSnapshotListTestJSON-1919428096 None] Create snapshot completed successfully Jul 10 18:16:01 devstack sudo[97191]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8d378987-e3f8-410e-b700-b3a107ef3186 1073741824" returned: 0 in 1.111s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8d378987-e3f8-410e-b700-b3a107ef3186 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:01 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8d378987-e3f8-410e-b700-b3a107ef3186 Jul 10 18:16:01 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-78c65d5a-6dad-491d-9261-566bb98cf4c2 tempest-VolumesSnapshotListTestJSON-1919428096 None] Acquiring lock "cinder-a760c365-3c02-4b2f-b1e7-f01a02673152-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:16:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-78c65d5a-6dad-491d-9261-566bb98cf4c2 tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "cinder-a760c365-3c02-4b2f-b1e7-f01a02673152-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:16:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-78c65d5a-6dad-491d-9261-566bb98cf4c2 tempest-VolumesSnapshotListTestJSON-1919428096 None] Acquiring lock "cinder-quobyte-d380b23e-54a0-4310-ab3a-833b39a04684" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:16:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-78c65d5a-6dad-491d-9261-566bb98cf4c2 tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "cinder-quobyte-d380b23e-54a0-4310-ab3a-833b39a04684" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:16:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-78c65d5a-6dad-491d-9261-566bb98cf4c2 tempest-VolumesSnapshotListTestJSON-1919428096 None] Acquiring lock "cinder-quobyte-a760c365-3c02-4b2f-b1e7-f01a02673152" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:16:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-78c65d5a-6dad-491d-9261-566bb98cf4c2 tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "cinder-quobyte-a760c365-3c02-4b2f-b1e7-f01a02673152" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:16:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-78c65d5a-6dad-491d-9261-566bb98cf4c2 tempest-VolumesSnapshotListTestJSON-1919428096 None] Deleting offline snapshot a760c365-3c02-4b2f-b1e7-f01a02673152 of volume d380b23e-54a0-4310-ab3a-833b39a04684 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:16:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-78c65d5a-6dad-491d-9261-566bb98cf4c2 tempest-VolumesSnapshotListTestJSON-1919428096 None] snapshot_file for this snap is: volume-d380b23e-54a0-4310-ab3a-833b39a04684.a760c365-3c02-4b2f-b1e7-f01a02673152 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:16:02 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[937c6b13-cdd7-4241-8db0-a437c12b12f4]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:16:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-78c65d5a-6dad-491d-9261-566bb98cf4c2 tempest-VolumesSnapshotListTestJSON-1919428096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a760c365-3c02-4b2f-b1e7-f01a02673152 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:02 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a760c365-3c02-4b2f-b1e7-f01a02673152 Jul 10 18:16:02 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:02 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8d378987-e3f8-410e-b700-b3a107ef3186" returned: 0 in 0.782s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] <== create_volume: return (1944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:16:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.948s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:16:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.295s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:16:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1955065605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=341953f1-cc38-4d42-80cf-7ca862694f83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90d1b5877411490abff36bb8898d6a8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:16:00Z,use_quota=True,user_id='31b33caa03d245a897d7858a2a80bff6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:16:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] Creating volume 341953f1-cc38-4d42-80cf-7ca862694f83 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:16:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:16:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:16:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:16:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:16:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:16:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:16:02 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:16:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-341953f1-cc38-4d42-80cf-7ca862694f83 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:02 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (063df9d5-9c10-4375-b590-31e27d0062c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d378987-e3f8-410e-b700-b3a107ef3186', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:02 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-341953f1-cc38-4d42-80cf-7ca862694f83 1073741824 Jul 10 18:16:02 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:02 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5974d865-3584-436a-b3a8-44d525ea84cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:02 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] Volume volume-8d378987-e3f8-410e-b700-b3a107ef3186 (8d378987-e3f8-410e-b700-b3a107ef3186): created successfully Jul 10 18:16:02 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5974d865-3584-436a-b3a8-44d525ea84cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:02 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] Flow 'volume_create_manager' (7ae6877d-a310-4d77-9e87-bdad7de2fdaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:16:02 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-957ff6f9-fea5-4503-86f1-0e4fb76b0661 tempest-AttachVolumeTestJSON-309313673 None] Created volume successfully. Jul 10 18:16:03 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-78c65d5a-6dad-491d-9261-566bb98cf4c2 tempest-VolumesSnapshotListTestJSON-1919428096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a760c365-3c02-4b2f-b1e7-f01a02673152" returned: 0 in 0.848s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-78c65d5a-6dad-491d-9261-566bb98cf4c2 tempest-VolumesSnapshotListTestJSON-1919428096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d380b23e-54a0-4310-ab3a-833b39a04684(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:16:03 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[40422ca0-a2fb-4429-8638-637f48de5fb2]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:16:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-78c65d5a-6dad-491d-9261-566bb98cf4c2 tempest-VolumesSnapshotListTestJSON-1919428096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.24eb18c7-d875-42ff-8eda-233e38cd2624 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:03 devstack sudo[97207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.24eb18c7-d875-42ff-8eda-233e38cd2624 Jul 10 18:16:03 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:03 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-341953f1-cc38-4d42-80cf-7ca862694f83 1073741824" returned: 0 in 0.993s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-341953f1-cc38-4d42-80cf-7ca862694f83 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:03 devstack sudo[97217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-341953f1-cc38-4d42-80cf-7ca862694f83 Jul 10 18:16:03 devstack sudo[97217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:04 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-78c65d5a-6dad-491d-9261-566bb98cf4c2 tempest-VolumesSnapshotListTestJSON-1919428096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.24eb18c7-d875-42ff-8eda-233e38cd2624" returned: 0 in 0.931s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:04 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-78c65d5a-6dad-491d-9261-566bb98cf4c2 tempest-VolumesSnapshotListTestJSON-1919428096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d380b23e-54a0-4310-ab3a-833b39a04684(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:16:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-78c65d5a-6dad-491d-9261-566bb98cf4c2 tempest-VolumesSnapshotListTestJSON-1919428096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a760c365-3c02-4b2f-b1e7-f01a02673152 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:04 devstack sudo[97222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a760c365-3c02-4b2f-b1e7-f01a02673152 Jul 10 18:16:04 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:04 devstack sudo[97217]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-341953f1-cc38-4d42-80cf-7ca862694f83" returned: 0 in 0.704s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:04 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:16:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:16:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06a30916-581d-47f1-8c4e-766fee6c0558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-341953f1-cc38-4d42-80cf-7ca862694f83', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f017cbbe-01e2-4ef4-a42f-f30ad5ff1fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:04 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] Volume volume-341953f1-cc38-4d42-80cf-7ca862694f83 (341953f1-cc38-4d42-80cf-7ca862694f83): created successfully Jul 10 18:16:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f017cbbe-01e2-4ef4-a42f-f30ad5ff1fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] Flow 'volume_create_manager' (14357bff-209c-421c-bc81-6bca891e87b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:16:04 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-4e46a65f-5eae-40b2-babf-3be53c468348 tempest-AbsoluteLimitsTests-1784695331 None] Created volume successfully. Jul 10 18:16:04 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-78c65d5a-6dad-491d-9261-566bb98cf4c2 tempest-VolumesSnapshotListTestJSON-1919428096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a760c365-3c02-4b2f-b1e7-f01a02673152" returned: 0 in 0.864s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-78c65d5a-6dad-491d-9261-566bb98cf4c2 tempest-VolumesSnapshotListTestJSON-1919428096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a760c365-3c02-4b2f-b1e7-f01a02673152 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:04 devstack sudo[97229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a760c365-3c02-4b2f-b1e7-f01a02673152 Jul 10 18:16:04 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:05 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-78c65d5a-6dad-491d-9261-566bb98cf4c2 tempest-VolumesSnapshotListTestJSON-1919428096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a760c365-3c02-4b2f-b1e7-f01a02673152" returned: 0 in 0.813s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:05 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f8b2636f-16a0-4021-bbf1-80f6ec2e7465 tempest-AbsoluteLimitsTests-1784695331 None] Acquiring lock "cinder-341953f1-cc38-4d42-80cf-7ca862694f83-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:16:05 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-78c65d5a-6dad-491d-9261-566bb98cf4c2 tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "cinder-quobyte-a760c365-3c02-4b2f-b1e7-f01a02673152" released by "_delete_snapshot" :: held 3.610s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:16:05 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-78c65d5a-6dad-491d-9261-566bb98cf4c2 tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "cinder-quobyte-d380b23e-54a0-4310-ab3a-833b39a04684" released by "delete_snapshot" :: held 3.644s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:16:05 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f8b2636f-16a0-4021-bbf1-80f6ec2e7465 tempest-AbsoluteLimitsTests-1784695331 None] Lock "cinder-341953f1-cc38-4d42-80cf-7ca862694f83-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:16:05 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f8b2636f-16a0-4021-bbf1-80f6ec2e7465 tempest-AbsoluteLimitsTests-1784695331 None] Acquiring lock "cinder-quobyte-341953f1-cc38-4d42-80cf-7ca862694f83" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:16:05 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f8b2636f-16a0-4021-bbf1-80f6ec2e7465 tempest-AbsoluteLimitsTests-1784695331 None] Lock "cinder-quobyte-341953f1-cc38-4d42-80cf-7ca862694f83" acquired by "delete_volume" :: waited 0.027s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:16:05 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-78c65d5a-6dad-491d-9261-566bb98cf4c2 tempest-VolumesSnapshotListTestJSON-1919428096 None] Created reservations ['7f6a2df9-afac-449b-b928-6f0cb3821cde', 'a406cd41-02f3-49b8-bd7a-08e311093adc', '2ea6d366-f9d2-41c5-8a39-122e0482953a', 'e369c3d8-40bb-46b3-b2fe-0a7ddf1354e1'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:16:05 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[1917fc1e-da2a-4e05-9fe3-c880c99e3c32]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:16:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f8b2636f-16a0-4021-bbf1-80f6ec2e7465 tempest-AbsoluteLimitsTests-1784695331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-341953f1-cc38-4d42-80cf-7ca862694f83 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:06 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-78c65d5a-6dad-491d-9261-566bb98cf4c2 tempest-VolumesSnapshotListTestJSON-1919428096 None] Delete snapshot completed successfully. Jul 10 18:16:06 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-78c65d5a-6dad-491d-9261-566bb98cf4c2 tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "cinder-a760c365-3c02-4b2f-b1e7-f01a02673152-delete_snapshot" released by "delete_snapshot" :: held 3.916s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:16:06 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-341953f1-cc38-4d42-80cf-7ca862694f83 Jul 10 18:16:06 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:06 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a46ecece-54a5-4d6e-9312-e3f022c580f9 tempest-VolumesSnapshotListTestJSON-1919428096 None] Acquiring lock "cinder-24eb18c7-d875-42ff-8eda-233e38cd2624-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:16:06 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a46ecece-54a5-4d6e-9312-e3f022c580f9 tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "cinder-24eb18c7-d875-42ff-8eda-233e38cd2624-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:16:06 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a46ecece-54a5-4d6e-9312-e3f022c580f9 tempest-VolumesSnapshotListTestJSON-1919428096 None] Acquiring lock "cinder-quobyte-d380b23e-54a0-4310-ab3a-833b39a04684" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:16:06 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a46ecece-54a5-4d6e-9312-e3f022c580f9 tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "cinder-quobyte-d380b23e-54a0-4310-ab3a-833b39a04684" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:16:06 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a46ecece-54a5-4d6e-9312-e3f022c580f9 tempest-VolumesSnapshotListTestJSON-1919428096 None] Acquiring lock "cinder-quobyte-24eb18c7-d875-42ff-8eda-233e38cd2624" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:16:06 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a46ecece-54a5-4d6e-9312-e3f022c580f9 tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "cinder-quobyte-24eb18c7-d875-42ff-8eda-233e38cd2624" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:16:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-a46ecece-54a5-4d6e-9312-e3f022c580f9 tempest-VolumesSnapshotListTestJSON-1919428096 None] Deleting offline snapshot 24eb18c7-d875-42ff-8eda-233e38cd2624 of volume d380b23e-54a0-4310-ab3a-833b39a04684 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:16:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-a46ecece-54a5-4d6e-9312-e3f022c580f9 tempest-VolumesSnapshotListTestJSON-1919428096 None] snapshot_file for this snap is: volume-d380b23e-54a0-4310-ab3a-833b39a04684.24eb18c7-d875-42ff-8eda-233e38cd2624 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:16:06 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e02b84-f791-4f14-adbf-b194540eca23]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:16:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a46ecece-54a5-4d6e-9312-e3f022c580f9 tempest-VolumesSnapshotListTestJSON-1919428096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.24eb18c7-d875-42ff-8eda-233e38cd2624 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:06 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.24eb18c7-d875-42ff-8eda-233e38cd2624 Jul 10 18:16:06 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-c2b70cd5-ffe4-4f03-b06b-6f60fa96a5ab req-e2da6875-a1fa-43fd-bf20-eb8d845e09bf tempest-AttachVolumeTestJSON-309313673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:16:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-c2b70cd5-ffe4-4f03-b06b-6f60fa96a5ab req-e2da6875-a1fa-43fd-bf20-eb8d845e09bf tempest-AttachVolumeTestJSON-309313673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:16:06 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b98c656-d0b6-4070-9e88-b9f7199ce818]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:16:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-c2b70cd5-ffe4-4f03-b06b-6f60fa96a5ab req-e2da6875-a1fa-43fd-bf20-eb8d845e09bf tempest-AttachVolumeTestJSON-309313673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8d378987-e3f8-410e-b700-b3a107ef3186 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:07 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f8b2636f-16a0-4021-bbf1-80f6ec2e7465 tempest-AbsoluteLimitsTests-1784695331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-341953f1-cc38-4d42-80cf-7ca862694f83" returned: 0 in 1.066s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f8b2636f-16a0-4021-bbf1-80f6ec2e7465 tempest-AbsoluteLimitsTests-1784695331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-341953f1-cc38-4d42-80cf-7ca862694f83 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:07 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8d378987-e3f8-410e-b700-b3a107ef3186 Jul 10 18:16:07 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:07 devstack sudo[97253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-341953f1-cc38-4d42-80cf-7ca862694f83 Jul 10 18:16:07 devstack sudo[97253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:07 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a46ecece-54a5-4d6e-9312-e3f022c580f9 tempest-VolumesSnapshotListTestJSON-1919428096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.24eb18c7-d875-42ff-8eda-233e38cd2624" returned: 0 in 1.193s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:07 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-a46ecece-54a5-4d6e-9312-e3f022c580f9 tempest-VolumesSnapshotListTestJSON-1919428096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d380b23e-54a0-4310-ab3a-833b39a04684(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:16:07 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fbc109-c064-4b51-95e9-340268c63848]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:16:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a46ecece-54a5-4d6e-9312-e3f022c580f9 tempest-VolumesSnapshotListTestJSON-1919428096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a73590b8-a5e8-4a3f-80e8-73b0d04bdd97 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:07 devstack sudo[97261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a73590b8-a5e8-4a3f-80e8-73b0d04bdd97 Jul 10 18:16:07 devstack sudo[97261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-c2b70cd5-ffe4-4f03-b06b-6f60fa96a5ab req-e2da6875-a1fa-43fd-bf20-eb8d845e09bf tempest-AttachVolumeTestJSON-309313673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8d378987-e3f8-410e-b700-b3a107ef3186" returned: 0 in 1.109s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-c2b70cd5-ffe4-4f03-b06b-6f60fa96a5ab req-e2da6875-a1fa-43fd-bf20-eb8d845e09bf tempest-AttachVolumeTestJSON-309313673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.137s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:16:08 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-c2b70cd5-ffe4-4f03-b06b-6f60fa96a5ab req-e2da6875-a1fa-43fd-bf20-eb8d845e09bf tempest-AttachVolumeTestJSON-309313673 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd', 'name': 'volume-8d378987-e3f8-410e-b700-b3a107ef3186', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3cb5b75e-fe6a-4cdf-8eff-6035502fc8e4', 'enforce_multipath': True} {{(pid=87399) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 18:16:08 devstack sudo[97253]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:08 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-c2b70cd5-ffe4-4f03-b06b-6f60fa96a5ab req-e2da6875-a1fa-43fd-bf20-eb8d845e09bf tempest-AttachVolumeTestJSON-309313673 None] attachment_update completed successfully. Jul 10 18:16:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f8b2636f-16a0-4021-bbf1-80f6ec2e7465 tempest-AbsoluteLimitsTests-1784695331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-341953f1-cc38-4d42-80cf-7ca862694f83" returned: 0 in 1.069s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:08 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f8b2636f-16a0-4021-bbf1-80f6ec2e7465 tempest-AbsoluteLimitsTests-1784695331 None] Lock "cinder-quobyte-341953f1-cc38-4d42-80cf-7ca862694f83" released by "delete_volume" :: held 2.211s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:16:08 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-f8b2636f-16a0-4021-bbf1-80f6ec2e7465 tempest-AbsoluteLimitsTests-1784695331 None] Created reservations ['827a152d-adc6-42c7-a7fc-30a9bbf827f5', 'd86943ba-61e1-4e6f-8e86-45af094d0937', '9c1c7320-e246-493e-88bf-09ff81ea3e80', '6ad78e22-ee6f-4427-b5f5-ba9ea6ffe476'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:16:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f8b2636f-16a0-4021-bbf1-80f6ec2e7465 tempest-AbsoluteLimitsTests-1784695331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:16:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f8b2636f-16a0-4021-bbf1-80f6ec2e7465 tempest-AbsoluteLimitsTests-1784695331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:16:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f8b2636f-16a0-4021-bbf1-80f6ec2e7465 tempest-AbsoluteLimitsTests-1784695331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:16:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f8b2636f-16a0-4021-bbf1-80f6ec2e7465 tempest-AbsoluteLimitsTests-1784695331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:16:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f8b2636f-16a0-4021-bbf1-80f6ec2e7465 tempest-AbsoluteLimitsTests-1784695331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:16:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f8b2636f-16a0-4021-bbf1-80f6ec2e7465 tempest-AbsoluteLimitsTests-1784695331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:08 devstack sudo[97265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:16:08 devstack sudo[97265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:08 devstack sudo[97261]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a46ecece-54a5-4d6e-9312-e3f022c580f9 tempest-VolumesSnapshotListTestJSON-1919428096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a73590b8-a5e8-4a3f-80e8-73b0d04bdd97" returned: 0 in 1.180s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-a46ecece-54a5-4d6e-9312-e3f022c580f9 tempest-VolumesSnapshotListTestJSON-1919428096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d380b23e-54a0-4310-ab3a-833b39a04684(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:16:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a46ecece-54a5-4d6e-9312-e3f022c580f9 tempest-VolumesSnapshotListTestJSON-1919428096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.24eb18c7-d875-42ff-8eda-233e38cd2624 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:09 devstack sudo[97271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.24eb18c7-d875-42ff-8eda-233e38cd2624 Jul 10 18:16:09 devstack sudo[97271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:09 devstack sudo[97265]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f8b2636f-16a0-4021-bbf1-80f6ec2e7465 tempest-AbsoluteLimitsTests-1784695331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.030s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:09 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-f8b2636f-16a0-4021-bbf1-80f6ec2e7465 tempest-AbsoluteLimitsTests-1784695331 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:16:09 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-f8b2636f-16a0-4021-bbf1-80f6ec2e7465 tempest-AbsoluteLimitsTests-1784695331 None] Deleted volume successfully. Jul 10 18:16:09 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f8b2636f-16a0-4021-bbf1-80f6ec2e7465 tempest-AbsoluteLimitsTests-1784695331 None] Lock "cinder-341953f1-cc38-4d42-80cf-7ca862694f83-delete_volume" released by "delete_volume" :: held 3.542s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:16:10 devstack sudo[97271]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a46ecece-54a5-4d6e-9312-e3f022c580f9 tempest-VolumesSnapshotListTestJSON-1919428096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.24eb18c7-d875-42ff-8eda-233e38cd2624" returned: 0 in 1.331s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a46ecece-54a5-4d6e-9312-e3f022c580f9 tempest-VolumesSnapshotListTestJSON-1919428096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.24eb18c7-d875-42ff-8eda-233e38cd2624 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:10 devstack sudo[97279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.24eb18c7-d875-42ff-8eda-233e38cd2624 Jul 10 18:16:10 devstack sudo[97279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:11 devstack sudo[97279]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a46ecece-54a5-4d6e-9312-e3f022c580f9 tempest-VolumesSnapshotListTestJSON-1919428096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.24eb18c7-d875-42ff-8eda-233e38cd2624" returned: 0 in 0.776s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:11 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a46ecece-54a5-4d6e-9312-e3f022c580f9 tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "cinder-quobyte-24eb18c7-d875-42ff-8eda-233e38cd2624" released by "_delete_snapshot" :: held 4.624s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:16:11 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a46ecece-54a5-4d6e-9312-e3f022c580f9 tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "cinder-quobyte-d380b23e-54a0-4310-ab3a-833b39a04684" released by "delete_snapshot" :: held 4.657s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:16:11 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-a46ecece-54a5-4d6e-9312-e3f022c580f9 tempest-VolumesSnapshotListTestJSON-1919428096 None] Created reservations ['beca26d3-1969-43ff-968b-ed3cb59835cd', '9ccccd00-9eb3-4f0c-9414-d49fdd927add', '7c853a94-ab6b-4b50-8ede-e05bdc555b09', 'a2ed4e53-69d9-46db-bbb8-4efcf725f5eb'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:16:11 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-a46ecece-54a5-4d6e-9312-e3f022c580f9 tempest-VolumesSnapshotListTestJSON-1919428096 None] Delete snapshot completed successfully. Jul 10 18:16:11 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a46ecece-54a5-4d6e-9312-e3f022c580f9 tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "cinder-24eb18c7-d875-42ff-8eda-233e38cd2624-delete_snapshot" released by "delete_snapshot" :: held 4.849s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:16:11 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-64c30f2e-90bb-4b00-aff7-ae3ad5843d05 tempest-VolumesSnapshotListTestJSON-1919428096 None] Acquiring lock "cinder-a73590b8-a5e8-4a3f-80e8-73b0d04bdd97-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:16:11 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-64c30f2e-90bb-4b00-aff7-ae3ad5843d05 tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "cinder-a73590b8-a5e8-4a3f-80e8-73b0d04bdd97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:16:11 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-64c30f2e-90bb-4b00-aff7-ae3ad5843d05 tempest-VolumesSnapshotListTestJSON-1919428096 None] Acquiring lock "cinder-quobyte-d380b23e-54a0-4310-ab3a-833b39a04684" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:16:11 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-64c30f2e-90bb-4b00-aff7-ae3ad5843d05 tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "cinder-quobyte-d380b23e-54a0-4310-ab3a-833b39a04684" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:16:11 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-64c30f2e-90bb-4b00-aff7-ae3ad5843d05 tempest-VolumesSnapshotListTestJSON-1919428096 None] Acquiring lock "cinder-quobyte-a73590b8-a5e8-4a3f-80e8-73b0d04bdd97" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:16:11 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-64c30f2e-90bb-4b00-aff7-ae3ad5843d05 tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "cinder-quobyte-a73590b8-a5e8-4a3f-80e8-73b0d04bdd97" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:16:11 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-64c30f2e-90bb-4b00-aff7-ae3ad5843d05 tempest-VolumesSnapshotListTestJSON-1919428096 None] Deleting offline snapshot a73590b8-a5e8-4a3f-80e8-73b0d04bdd97 of volume d380b23e-54a0-4310-ab3a-833b39a04684 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:16:11 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-64c30f2e-90bb-4b00-aff7-ae3ad5843d05 tempest-VolumesSnapshotListTestJSON-1919428096 None] snapshot_file for this snap is: volume-d380b23e-54a0-4310-ab3a-833b39a04684.a73590b8-a5e8-4a3f-80e8-73b0d04bdd97 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:16:11 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b16d5a-f4bc-497b-be6b-3a776192f63a]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:16:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64c30f2e-90bb-4b00-aff7-ae3ad5843d05 tempest-VolumesSnapshotListTestJSON-1919428096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a73590b8-a5e8-4a3f-80e8-73b0d04bdd97 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:12 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a73590b8-a5e8-4a3f-80e8-73b0d04bdd97 Jul 10 18:16:12 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:12 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64c30f2e-90bb-4b00-aff7-ae3ad5843d05 tempest-VolumesSnapshotListTestJSON-1919428096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a73590b8-a5e8-4a3f-80e8-73b0d04bdd97" returned: 0 in 0.911s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:12 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-64c30f2e-90bb-4b00-aff7-ae3ad5843d05 tempest-VolumesSnapshotListTestJSON-1919428096 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d380b23e-54a0-4310-ab3a-833b39a04684(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:16:12 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[7685c4cc-8d11-4f49-89b6-f1a2a9381bea]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:16:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64c30f2e-90bb-4b00-aff7-ae3ad5843d05 tempest-VolumesSnapshotListTestJSON-1919428096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:13 devstack sudo[97287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684 Jul 10 18:16:13 devstack sudo[97287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:14 devstack sudo[97287]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64c30f2e-90bb-4b00-aff7-ae3ad5843d05 tempest-VolumesSnapshotListTestJSON-1919428096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684" returned: 0 in 1.066s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64c30f2e-90bb-4b00-aff7-ae3ad5843d05 tempest-VolumesSnapshotListTestJSON-1919428096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a73590b8-a5e8-4a3f-80e8-73b0d04bdd97 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:14 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a73590b8-a5e8-4a3f-80e8-73b0d04bdd97 Jul 10 18:16:14 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:14 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64c30f2e-90bb-4b00-aff7-ae3ad5843d05 tempest-VolumesSnapshotListTestJSON-1919428096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a73590b8-a5e8-4a3f-80e8-73b0d04bdd97" returned: 0 in 0.802s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64c30f2e-90bb-4b00-aff7-ae3ad5843d05 tempest-VolumesSnapshotListTestJSON-1919428096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a73590b8-a5e8-4a3f-80e8-73b0d04bdd97 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:14 devstack sudo[97325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a73590b8-a5e8-4a3f-80e8-73b0d04bdd97 Jul 10 18:16:14 devstack sudo[97325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:15 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-2978abc8-bfb8-47dd-9c5a-2f87d1634011 req-01b8f967-973a-447c-8794-09a4960425af tempest-AttachVolumeTestJSON-309313673 None] Terminate volume connection completed successfully. Jul 10 18:16:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-2978abc8-bfb8-47dd-9c5a-2f87d1634011 req-01b8f967-973a-447c-8794-09a4960425af tempest-AttachVolumeTestJSON-309313673 None] Deleting attachment 742b18b7-db54-42ea-81d4-d980919798b5. {{(pid=87399) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 18:16:15 devstack sudo[97325]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64c30f2e-90bb-4b00-aff7-ae3ad5843d05 tempest-VolumesSnapshotListTestJSON-1919428096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684.a73590b8-a5e8-4a3f-80e8-73b0d04bdd97" returned: 0 in 0.799s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:15 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-64c30f2e-90bb-4b00-aff7-ae3ad5843d05 tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "cinder-quobyte-a73590b8-a5e8-4a3f-80e8-73b0d04bdd97" released by "_delete_snapshot" :: held 3.750s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:16:15 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-64c30f2e-90bb-4b00-aff7-ae3ad5843d05 tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "cinder-quobyte-d380b23e-54a0-4310-ab3a-833b39a04684" released by "delete_snapshot" :: held 3.784s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:16:15 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-64c30f2e-90bb-4b00-aff7-ae3ad5843d05 tempest-VolumesSnapshotListTestJSON-1919428096 None] Created reservations ['0359cbdd-fdf4-46ca-81d6-20ffd1bb8bb4', 'cf9fc242-720a-4dcf-8c88-5742771c8567', '3e59bfa8-748a-45d8-aa57-94f79bb24fe1', 'e2a71a22-ff9f-4592-897e-6c4b55151050'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:16:15 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-64c30f2e-90bb-4b00-aff7-ae3ad5843d05 tempest-VolumesSnapshotListTestJSON-1919428096 None] Delete snapshot completed successfully. Jul 10 18:16:15 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-64c30f2e-90bb-4b00-aff7-ae3ad5843d05 tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "cinder-a73590b8-a5e8-4a3f-80e8-73b0d04bdd97-delete_snapshot" released by "delete_snapshot" :: held 3.970s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:16:16 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e48bf37e-8126-4305-96ee-16aed7e8b855 tempest-VolumesSnapshotListTestJSON-1919428096 None] Acquiring lock "cinder-d380b23e-54a0-4310-ab3a-833b39a04684-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:16:16 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e48bf37e-8126-4305-96ee-16aed7e8b855 tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "cinder-d380b23e-54a0-4310-ab3a-833b39a04684-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:16:16 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e48bf37e-8126-4305-96ee-16aed7e8b855 tempest-VolumesSnapshotListTestJSON-1919428096 None] Acquiring lock "cinder-quobyte-d380b23e-54a0-4310-ab3a-833b39a04684" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:16:16 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e48bf37e-8126-4305-96ee-16aed7e8b855 tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "cinder-quobyte-d380b23e-54a0-4310-ab3a-833b39a04684" acquired by "delete_volume" :: waited 0.023s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:16:16 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33d7291-562e-48c1-8a2e-7e11963b5a14]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:16:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e48bf37e-8126-4305-96ee-16aed7e8b855 tempest-VolumesSnapshotListTestJSON-1919428096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:16 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684 Jul 10 18:16:16 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:17 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e48bf37e-8126-4305-96ee-16aed7e8b855 tempest-VolumesSnapshotListTestJSON-1919428096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684" returned: 0 in 1.120s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e48bf37e-8126-4305-96ee-16aed7e8b855 tempest-VolumesSnapshotListTestJSON-1919428096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:17 devstack sudo[97337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684 Jul 10 18:16:17 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:17 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:16:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] Flow 'volume_create_manager' (ef290372-f30b-4037-87d0-347abc32cd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:16:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9eec525-8da5-4fa4-9ffa-80be3d70c6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9eec525-8da5-4fa4-9ffa-80be3d70c6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-492625359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce4783cb-9bb9-4620-8217-50780c8a1279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21259f8fe2264d71b2218d2ee8304da1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:16:18Z,use_quota=True,user_id='fb26052a4c4b4d5ba32202a7bdf3b80e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f179d7-ee8d-41f1-915d-a57431cb84ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f179d7-ee8d-41f1-915d-a57431cb84ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f978f000-d142-472c-ad67-b4596074ac21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f978f000-d142-472c-ad67-b4596074ac21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce4783cb-9bb9-4620-8217-50780c8a1279', 'volume_name': 'volume-ce4783cb-9bb9-4620-8217-50780c8a1279', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca56a239-e9f5-423c-b543-0fad0bffbbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca56a239-e9f5-423c-b543-0fad0bffbbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8620a8b-3c45-4955-8b2a-5c25915485ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:17 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] Volume ce4783cb-9bb9-4620-8217-50780c8a1279: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce4783cb-9bb9-4620-8217-50780c8a1279', 'volume_size': 1} Jul 10 18:16:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:16:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:16:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-492625359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce4783cb-9bb9-4620-8217-50780c8a1279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21259f8fe2264d71b2218d2ee8304da1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:16:18Z,use_quota=True,user_id='fb26052a4c4b4d5ba32202a7bdf3b80e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:16:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] Creating volume ce4783cb-9bb9-4620-8217-50780c8a1279 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:16:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:16:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:16:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:16:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:16:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:16:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:16:17 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:16:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ce4783cb-9bb9-4620-8217-50780c8a1279 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:17 devstack sudo[97339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ce4783cb-9bb9-4620-8217-50780c8a1279 1073741824 Jul 10 18:16:17 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:18 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-b0ee7dbb-27ee-4cd5-b828-77c35339f126 req-e9e30d82-c76b-4a39-be9d-9033e6fe52dd tempest-AttachVolumeTestJSON-309313673 None] Terminate volume connection completed successfully. Jul 10 18:16:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-b0ee7dbb-27ee-4cd5-b828-77c35339f126 req-e9e30d82-c76b-4a39-be9d-9033e6fe52dd tempest-AttachVolumeTestJSON-309313673 None] Deleting attachment 3cb5b75e-fe6a-4cdf-8eff-6035502fc8e4. {{(pid=87399) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 18:16:18 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e48bf37e-8126-4305-96ee-16aed7e8b855 tempest-VolumesSnapshotListTestJSON-1919428096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d380b23e-54a0-4310-ab3a-833b39a04684" returned: 0 in 0.880s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:18 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e48bf37e-8126-4305-96ee-16aed7e8b855 tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "cinder-quobyte-d380b23e-54a0-4310-ab3a-833b39a04684" released by "delete_volume" :: held 2.116s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:16:18 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-e48bf37e-8126-4305-96ee-16aed7e8b855 tempest-VolumesSnapshotListTestJSON-1919428096 None] Created reservations ['2c909eed-b1d3-4481-a999-3197528d6b72', 'fceaa1dc-2362-4d5a-a6ec-0b884c625c0b', '1b992cf5-9398-4d64-a758-1901a29aea92', 'bf1a8aa2-6d11-45fa-8e20-f6611c453883'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:16:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e48bf37e-8126-4305-96ee-16aed7e8b855 tempest-VolumesSnapshotListTestJSON-1919428096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:16:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e48bf37e-8126-4305-96ee-16aed7e8b855 tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:16:18 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e48bf37e-8126-4305-96ee-16aed7e8b855 tempest-VolumesSnapshotListTestJSON-1919428096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:16:18 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e48bf37e-8126-4305-96ee-16aed7e8b855 tempest-VolumesSnapshotListTestJSON-1919428096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:16:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e48bf37e-8126-4305-96ee-16aed7e8b855 tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:16:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e48bf37e-8126-4305-96ee-16aed7e8b855 tempest-VolumesSnapshotListTestJSON-1919428096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:18 devstack sudo[97349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:16:18 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:18 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ce4783cb-9bb9-4620-8217-50780c8a1279 1073741824" returned: 0 in 1.072s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ce4783cb-9bb9-4620-8217-50780c8a1279 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:18 devstack sudo[97351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ce4783cb-9bb9-4620-8217-50780c8a1279 Jul 10 18:16:18 devstack sudo[97351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:19 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e48bf37e-8126-4305-96ee-16aed7e8b855 tempest-VolumesSnapshotListTestJSON-1919428096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.215s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:19 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-e48bf37e-8126-4305-96ee-16aed7e8b855 tempest-VolumesSnapshotListTestJSON-1919428096 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:16:19 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-e48bf37e-8126-4305-96ee-16aed7e8b855 tempest-VolumesSnapshotListTestJSON-1919428096 None] Deleted volume successfully. Jul 10 18:16:19 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e48bf37e-8126-4305-96ee-16aed7e8b855 tempest-VolumesSnapshotListTestJSON-1919428096 None] Lock "cinder-d380b23e-54a0-4310-ab3a-833b39a04684-delete_volume" released by "delete_volume" :: held 3.624s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:16:19 devstack sudo[97351]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ce4783cb-9bb9-4620-8217-50780c8a1279" returned: 0 in 1.160s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:19 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] <== create_volume: return (2301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:16:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.304s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:16:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8620a8b-3c45-4955-8b2a-5c25915485ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce4783cb-9bb9-4620-8217-50780c8a1279', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d05a80-b44c-4044-9786-698558fef810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:20 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] Volume volume-ce4783cb-9bb9-4620-8217-50780c8a1279 (ce4783cb-9bb9-4620-8217-50780c8a1279): created successfully Jul 10 18:16:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d05a80-b44c-4044-9786-698558fef810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] Flow 'volume_create_manager' (ef290372-f30b-4037-87d0-347abc32cd11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:16:20 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-435553e7-ee6a-448e-9a0a-b7408ae6a2d5 tempest-VolumesTransfersTest-1859510085 None] Created volume successfully. Jul 10 18:16:21 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-52141950-570a-4044-876d-6565212103b5 tempest-VolumesTransfersTest-931062789 None] Transfer volume completed successfully. Jul 10 18:16:23 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0e7bf170-8a68-482d-b5e9-253fcd21c6ce tempest-VolumesTransfersTest-1874872304 None] Acquiring lock "cinder-ce4783cb-9bb9-4620-8217-50780c8a1279-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:16:23 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0e7bf170-8a68-482d-b5e9-253fcd21c6ce tempest-VolumesTransfersTest-1874872304 None] Lock "cinder-ce4783cb-9bb9-4620-8217-50780c8a1279-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:16:23 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0e7bf170-8a68-482d-b5e9-253fcd21c6ce tempest-VolumesTransfersTest-1874872304 None] Acquiring lock "cinder-quobyte-ce4783cb-9bb9-4620-8217-50780c8a1279" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:16:23 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0e7bf170-8a68-482d-b5e9-253fcd21c6ce tempest-VolumesTransfersTest-1874872304 None] Lock "cinder-quobyte-ce4783cb-9bb9-4620-8217-50780c8a1279" acquired by "delete_volume" :: waited 0.019s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:16:23 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2929d7-f7e2-46d7-9174-8c1dffe77b62]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:16:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0e7bf170-8a68-482d-b5e9-253fcd21c6ce tempest-VolumesTransfersTest-1874872304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ce4783cb-9bb9-4620-8217-50780c8a1279 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:23 devstack sudo[97376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ce4783cb-9bb9-4620-8217-50780c8a1279 Jul 10 18:16:23 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:24 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:16:24 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Flow 'volume_create_manager' (80e90af0-29d2-426c-95f4-d5a6d5213fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:16:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca023df5-2fb4-4703-94a5-863218b482a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0e7bf170-8a68-482d-b5e9-253fcd21c6ce tempest-VolumesTransfersTest-1874872304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ce4783cb-9bb9-4620-8217-50780c8a1279" returned: 0 in 1.417s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0e7bf170-8a68-482d-b5e9-253fcd21c6ce tempest-VolumesTransfersTest-1874872304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ce4783cb-9bb9-4620-8217-50780c8a1279 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca023df5-2fb4-4703-94a5-863218b482a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2033624236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=676b02f2-1508-4ae1-97a2-ba6ed5191b0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d315f37907d848ccaa25f9e76220d5ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:16:25Z,use_quota=True,user_id='2c59125e82144d8c9c9e3cdbdd31156b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac0d2cd6-9fa5-49f2-8159-0e4259e244af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:24 devstack sudo[97383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ce4783cb-9bb9-4620-8217-50780c8a1279 Jul 10 18:16:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac0d2cd6-9fa5-49f2-8159-0e4259e244af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:24 devstack sudo[97383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b2e1d3-e7a3-415a-b4ef-83b849a3bc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b2e1d3-e7a3-415a-b4ef-83b849a3bc92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '676b02f2-1508-4ae1-97a2-ba6ed5191b0d', 'volume_name': 'volume-676b02f2-1508-4ae1-97a2-ba6ed5191b0d', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73334c7b-921a-4170-892f-79b0a8fdfa50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73334c7b-921a-4170-892f-79b0a8fdfa50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb59943f-b13b-4bda-b81a-ccfbcdd00116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:24 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Volume 676b02f2-1508-4ae1-97a2-ba6ed5191b0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-676b02f2-1508-4ae1-97a2-ba6ed5191b0d', 'volume_size': 1} Jul 10 18:16:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:16:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:16:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2033624236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=676b02f2-1508-4ae1-97a2-ba6ed5191b0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d315f37907d848ccaa25f9e76220d5ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:16:25Z,use_quota=True,user_id='2c59125e82144d8c9c9e3cdbdd31156b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:16:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Creating volume 676b02f2-1508-4ae1-97a2-ba6ed5191b0d {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:16:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:16:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:16:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:16:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:16:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:16:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:16:24 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:16:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-676b02f2-1508-4ae1-97a2-ba6ed5191b0d 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:24 devstack sudo[97385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-676b02f2-1508-4ae1-97a2-ba6ed5191b0d 1073741824 Jul 10 18:16:24 devstack sudo[97385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:25 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:16:25 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] Flow 'volume_create_manager' (0617fc57-52e4-4d71-8153-76d1de73f138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:16:25 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b39fae0f-576b-4b7a-910a-0529cc3f5ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:25 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b39fae0f-576b-4b7a-910a-0529cc3f5ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1825482437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a002ed-7e38-47f0-b3fd-d6c30607efa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d315f37907d848ccaa25f9e76220d5ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:16:25Z,use_quota=True,user_id='2c59125e82144d8c9c9e3cdbdd31156b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:25 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05a674c0-515c-4f88-8ec0-f43f5c23b8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:25 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05a674c0-515c-4f88-8ec0-f43f5c23b8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:25 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db0ac078-9c82-442c-a55c-06aaba137a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:25 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db0ac078-9c82-442c-a55c-06aaba137a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21a002ed-7e38-47f0-b3fd-d6c30607efa4', 'volume_name': 'volume-21a002ed-7e38-47f0-b3fd-d6c30607efa4', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:25 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cabb804-9253-4478-8ee1-c9929f7d1318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:25 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cabb804-9253-4478-8ee1-c9929f7d1318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:25 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80c015e9-234a-406b-a130-f09d14e408ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:25 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] Volume 21a002ed-7e38-47f0-b3fd-d6c30607efa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21a002ed-7e38-47f0-b3fd-d6c30607efa4', 'volume_size': 1} Jul 10 18:16:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:16:26 devstack sudo[97383]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0e7bf170-8a68-482d-b5e9-253fcd21c6ce tempest-VolumesTransfersTest-1874872304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ce4783cb-9bb9-4620-8217-50780c8a1279" returned: 0 in 1.396s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:26 devstack sudo[97385]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:26 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0e7bf170-8a68-482d-b5e9-253fcd21c6ce tempest-VolumesTransfersTest-1874872304 None] Lock "cinder-quobyte-ce4783cb-9bb9-4620-8217-50780c8a1279" released by "delete_volume" :: held 2.910s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:16:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-676b02f2-1508-4ae1-97a2-ba6ed5191b0d 1073741824" returned: 0 in 1.299s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-676b02f2-1508-4ae1-97a2-ba6ed5191b0d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:26 devstack sudo[97394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-676b02f2-1508-4ae1-97a2-ba6ed5191b0d Jul 10 18:16:26 devstack sudo[97394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:26 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-0e7bf170-8a68-482d-b5e9-253fcd21c6ce tempest-VolumesTransfersTest-1874872304 None] Created reservations ['a202c1bd-b67a-417e-9b6b-dfad36540639', 'a2d62496-f9be-4057-9f8a-3051eadd6e14', '38d6481d-61c1-4380-bf97-a6a96128e04e', '3d9b07e1-0e21-4505-8ace-875e18a59233'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:16:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0e7bf170-8a68-482d-b5e9-253fcd21c6ce tempest-VolumesTransfersTest-1874872304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:16:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0e7bf170-8a68-482d-b5e9-253fcd21c6ce tempest-VolumesTransfersTest-1874872304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:16:26 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0e7bf170-8a68-482d-b5e9-253fcd21c6ce tempest-VolumesTransfersTest-1874872304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:16:26 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0e7bf170-8a68-482d-b5e9-253fcd21c6ce tempest-VolumesTransfersTest-1874872304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:16:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0e7bf170-8a68-482d-b5e9-253fcd21c6ce tempest-VolumesTransfersTest-1874872304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:16:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0e7bf170-8a68-482d-b5e9-253fcd21c6ce tempest-VolumesTransfersTest-1874872304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:26 devstack sudo[97396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:16:26 devstack sudo[97396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:27 devstack sudo[97394]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-676b02f2-1508-4ae1-97a2-ba6ed5191b0d" returned: 0 in 1.051s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:27 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] <== create_volume: return (2402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:16:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.414s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:16:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.694s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:16:27 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1825482437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a002ed-7e38-47f0-b3fd-d6c30607efa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d315f37907d848ccaa25f9e76220d5ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:16:25Z,use_quota=True,user_id='2c59125e82144d8c9c9e3cdbdd31156b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:16:27 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] Creating volume 21a002ed-7e38-47f0-b3fd-d6c30607efa4 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:16:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:16:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:16:27 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:16:27 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:16:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:16:27 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:16:27 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:16:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-21a002ed-7e38-47f0-b3fd-d6c30607efa4 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb59943f-b13b-4bda-b81a-ccfbcdd00116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-676b02f2-1508-4ae1-97a2-ba6ed5191b0d', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79000777-95b1-4137-a865-4d8d111e03fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:27 devstack sudo[97400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-21a002ed-7e38-47f0-b3fd-d6c30607efa4 1073741824 Jul 10 18:16:27 devstack sudo[97400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:27 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Volume volume-676b02f2-1508-4ae1-97a2-ba6ed5191b0d (676b02f2-1508-4ae1-97a2-ba6ed5191b0d): created successfully Jul 10 18:16:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79000777-95b1-4137-a865-4d8d111e03fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Flow 'volume_create_manager' (80e90af0-29d2-426c-95f4-d5a6d5213fd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:16:27 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-9a1a7876-f001-48a0-b0b5-45d6f8b76043 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Created volume successfully. Jul 10 18:16:27 devstack sudo[97396]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0e7bf170-8a68-482d-b5e9-253fcd21c6ce tempest-VolumesTransfersTest-1874872304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.149s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:27 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-0e7bf170-8a68-482d-b5e9-253fcd21c6ce tempest-VolumesTransfersTest-1874872304 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:16:27 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-0e7bf170-8a68-482d-b5e9-253fcd21c6ce tempest-VolumesTransfersTest-1874872304 None] Deleted volume successfully. Jul 10 18:16:27 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0e7bf170-8a68-482d-b5e9-253fcd21c6ce tempest-VolumesTransfersTest-1874872304 None] Lock "cinder-ce4783cb-9bb9-4620-8217-50780c8a1279-delete_volume" released by "delete_volume" :: held 4.342s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:16:27 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:16:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] Flow 'volume_create_manager' (3d7e1ceb-d769-4612-887a-46f3c2adf4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:16:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b9ece3a-e9df-4372-8ee5-314aa62b4712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b9ece3a-e9df-4372-8ee5-314aa62b4712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-259053243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae8d6a4-43a0-4b11-8b3e-2e541a42dbdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21259f8fe2264d71b2218d2ee8304da1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:16:28Z,use_quota=True,user_id='fb26052a4c4b4d5ba32202a7bdf3b80e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0819a7a9-ef9a-40ff-af5c-6484f61b4cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0819a7a9-ef9a-40ff-af5c-6484f61b4cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9db5c08f-f22a-447c-95a3-a7e088424e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9db5c08f-f22a-447c-95a3-a7e088424e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ae8d6a4-43a0-4b11-8b3e-2e541a42dbdd', 'volume_name': 'volume-4ae8d6a4-43a0-4b11-8b3e-2e541a42dbdd', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f7d9e5-e616-4a4d-baa5-a7e7180bab03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33f7d9e5-e616-4a4d-baa5-a7e7180bab03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e8d8337-033a-4412-aebf-3ad4a8e13672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:27 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] Volume 4ae8d6a4-43a0-4b11-8b3e-2e541a42dbdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ae8d6a4-43a0-4b11-8b3e-2e541a42dbdd', 'volume_size': 1} Jul 10 18:16:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:16:28 devstack sudo[97400]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-21a002ed-7e38-47f0-b3fd-d6c30607efa4 1073741824" returned: 0 in 1.042s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-21a002ed-7e38-47f0-b3fd-d6c30607efa4 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:28 devstack sudo[97406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-21a002ed-7e38-47f0-b3fd-d6c30607efa4 Jul 10 18:16:28 devstack sudo[97406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:29 devstack sudo[97406]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-21a002ed-7e38-47f0-b3fd-d6c30607efa4" returned: 0 in 0.790s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:16:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:16:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.386s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:16:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:16:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-259053243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae8d6a4-43a0-4b11-8b3e-2e541a42dbdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21259f8fe2264d71b2218d2ee8304da1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:16:28Z,use_quota=True,user_id='fb26052a4c4b4d5ba32202a7bdf3b80e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:16:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] Creating volume 4ae8d6a4-43a0-4b11-8b3e-2e541a42dbdd {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:16:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:16:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:16:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:16:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:16:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:16:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:16:29 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:16:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4ae8d6a4-43a0-4b11-8b3e-2e541a42dbdd 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80c015e9-234a-406b-a130-f09d14e408ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21a002ed-7e38-47f0-b3fd-d6c30607efa4', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:29 devstack sudo[97412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4ae8d6a4-43a0-4b11-8b3e-2e541a42dbdd 1073741824 Jul 10 18:16:29 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab18dc4d-1aa8-488e-8239-1ac1ed9ee4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:29 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] Volume volume-21a002ed-7e38-47f0-b3fd-d6c30607efa4 (21a002ed-7e38-47f0-b3fd-d6c30607efa4): created successfully Jul 10 18:16:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab18dc4d-1aa8-488e-8239-1ac1ed9ee4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] Flow 'volume_create_manager' (0617fc57-52e4-4d71-8153-76d1de73f138) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:16:29 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-d7177ceb-a185-4099-914c-8e44a315b8ff tempest-TestServerVolumeAttachmentScenario-1008122108 None] Created volume successfully. Jul 10 18:16:30 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4ae8d6a4-43a0-4b11-8b3e-2e541a42dbdd 1073741824" returned: 0 in 1.015s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4ae8d6a4-43a0-4b11-8b3e-2e541a42dbdd {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:30 devstack sudo[97417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4ae8d6a4-43a0-4b11-8b3e-2e541a42dbdd Jul 10 18:16:30 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:31 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b3765c25-8792-4697-8d74-3f11384c5335 tempest-AttachVolumeTestJSON-309313673 None] Acquiring lock "cinder-8d378987-e3f8-410e-b700-b3a107ef3186-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:16:31 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b3765c25-8792-4697-8d74-3f11384c5335 tempest-AttachVolumeTestJSON-309313673 None] Lock "cinder-8d378987-e3f8-410e-b700-b3a107ef3186-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:16:31 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b3765c25-8792-4697-8d74-3f11384c5335 tempest-AttachVolumeTestJSON-309313673 None] Acquiring lock "cinder-quobyte-8d378987-e3f8-410e-b700-b3a107ef3186" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:16:31 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b3765c25-8792-4697-8d74-3f11384c5335 tempest-AttachVolumeTestJSON-309313673 None] Lock "cinder-quobyte-8d378987-e3f8-410e-b700-b3a107ef3186" acquired by "delete_volume" :: waited 0.029s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:16:31 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[db960773-6ff1-4b1b-b07c-38a92cbeb52c]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:16:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b3765c25-8792-4697-8d74-3f11384c5335 tempest-AttachVolumeTestJSON-309313673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8d378987-e3f8-410e-b700-b3a107ef3186 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:31 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4ae8d6a4-43a0-4b11-8b3e-2e541a42dbdd" returned: 0 in 1.058s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:31 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] <== create_volume: return (2156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:16:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.162s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:16:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e8d8337-033a-4412-aebf-3ad4a8e13672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ae8d6a4-43a0-4b11-8b3e-2e541a42dbdd', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ad8b4c-0a27-46ff-813a-47758d9adbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:31 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] Volume volume-4ae8d6a4-43a0-4b11-8b3e-2e541a42dbdd (4ae8d6a4-43a0-4b11-8b3e-2e541a42dbdd): created successfully Jul 10 18:16:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ad8b4c-0a27-46ff-813a-47758d9adbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] Flow 'volume_create_manager' (3d7e1ceb-d769-4612-887a-46f3c2adf4ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:16:31 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-037de8a0-3cb9-4a36-8da8-7ef47ba04252 tempest-VolumesTransfersTest-1859510085 None] Created volume successfully. Jul 10 18:16:31 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8d378987-e3f8-410e-b700-b3a107ef3186 Jul 10 18:16:31 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:32 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c635bf03-70f9-4f10-a5a5-5380e055d932 tempest-VolumesTransfersTest-1874872304 None] Acquiring lock "cinder-4ae8d6a4-43a0-4b11-8b3e-2e541a42dbdd-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:16:32 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c635bf03-70f9-4f10-a5a5-5380e055d932 tempest-VolumesTransfersTest-1874872304 None] Lock "cinder-4ae8d6a4-43a0-4b11-8b3e-2e541a42dbdd-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:16:32 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c635bf03-70f9-4f10-a5a5-5380e055d932 tempest-VolumesTransfersTest-1874872304 None] Acquiring lock "cinder-quobyte-4ae8d6a4-43a0-4b11-8b3e-2e541a42dbdd" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:16:32 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c635bf03-70f9-4f10-a5a5-5380e055d932 tempest-VolumesTransfersTest-1874872304 None] Lock "cinder-quobyte-4ae8d6a4-43a0-4b11-8b3e-2e541a42dbdd" acquired by "delete_volume" :: waited 0.028s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:16:32 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8ca084-6a4a-42d3-9b8e-e31a1092a00b]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:16:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c635bf03-70f9-4f10-a5a5-5380e055d932 tempest-VolumesTransfersTest-1874872304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4ae8d6a4-43a0-4b11-8b3e-2e541a42dbdd {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:32 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b3765c25-8792-4697-8d74-3f11384c5335 tempest-AttachVolumeTestJSON-309313673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8d378987-e3f8-410e-b700-b3a107ef3186" returned: 0 in 1.211s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b3765c25-8792-4697-8d74-3f11384c5335 tempest-AttachVolumeTestJSON-309313673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8d378987-e3f8-410e-b700-b3a107ef3186 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:32 devstack sudo[97426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8d378987-e3f8-410e-b700-b3a107ef3186 Jul 10 18:16:32 devstack sudo[97426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:32 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4ae8d6a4-43a0-4b11-8b3e-2e541a42dbdd Jul 10 18:16:32 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:33 devstack sudo[97426]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b3765c25-8792-4697-8d74-3f11384c5335 tempest-AttachVolumeTestJSON-309313673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8d378987-e3f8-410e-b700-b3a107ef3186" returned: 0 in 0.764s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:33 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b3765c25-8792-4697-8d74-3f11384c5335 tempest-AttachVolumeTestJSON-309313673 None] Lock "cinder-quobyte-8d378987-e3f8-410e-b700-b3a107ef3186" released by "delete_volume" :: held 2.051s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:16:33 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-b3765c25-8792-4697-8d74-3f11384c5335 tempest-AttachVolumeTestJSON-309313673 None] Created reservations ['cd10811e-0b9f-493d-98db-75a90d1904d4', '7063811f-4d0d-4003-b19c-e70b6d520b31', 'd8a9d56b-0ac8-4eda-8126-23bb745c1f19', '9758fc74-fe98-4602-a80c-cfbbcdba31b4'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:16:33 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c635bf03-70f9-4f10-a5a5-5380e055d932 tempest-VolumesTransfersTest-1874872304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4ae8d6a4-43a0-4b11-8b3e-2e541a42dbdd" returned: 0 in 1.015s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c635bf03-70f9-4f10-a5a5-5380e055d932 tempest-VolumesTransfersTest-1874872304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4ae8d6a4-43a0-4b11-8b3e-2e541a42dbdd {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:33 devstack sudo[97434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4ae8d6a4-43a0-4b11-8b3e-2e541a42dbdd Jul 10 18:16:33 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b3765c25-8792-4697-8d74-3f11384c5335 tempest-AttachVolumeTestJSON-309313673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:16:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b3765c25-8792-4697-8d74-3f11384c5335 tempest-AttachVolumeTestJSON-309313673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:16:33 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b3765c25-8792-4697-8d74-3f11384c5335 tempest-AttachVolumeTestJSON-309313673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:16:33 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b3765c25-8792-4697-8d74-3f11384c5335 tempest-AttachVolumeTestJSON-309313673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:16:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b3765c25-8792-4697-8d74-3f11384c5335 tempest-AttachVolumeTestJSON-309313673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:16:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b3765c25-8792-4697-8d74-3f11384c5335 tempest-AttachVolumeTestJSON-309313673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:33 devstack sudo[97436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:16:33 devstack sudo[97436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:34 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c635bf03-70f9-4f10-a5a5-5380e055d932 tempest-VolumesTransfersTest-1874872304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4ae8d6a4-43a0-4b11-8b3e-2e541a42dbdd" returned: 0 in 0.745s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:34 devstack sudo[97436]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b3765c25-8792-4697-8d74-3f11384c5335 tempest-AttachVolumeTestJSON-309313673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.709s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:34 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-b3765c25-8792-4697-8d74-3f11384c5335 tempest-AttachVolumeTestJSON-309313673 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:16:34 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c635bf03-70f9-4f10-a5a5-5380e055d932 tempest-VolumesTransfersTest-1874872304 None] Lock "cinder-quobyte-4ae8d6a4-43a0-4b11-8b3e-2e541a42dbdd" released by "delete_volume" :: held 1.842s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:16:34 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-b3765c25-8792-4697-8d74-3f11384c5335 tempest-AttachVolumeTestJSON-309313673 None] Deleted volume successfully. Jul 10 18:16:34 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b3765c25-8792-4697-8d74-3f11384c5335 tempest-AttachVolumeTestJSON-309313673 None] Lock "cinder-8d378987-e3f8-410e-b700-b3a107ef3186-delete_volume" released by "delete_volume" :: held 3.167s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:16:34 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-c635bf03-70f9-4f10-a5a5-5380e055d932 tempest-VolumesTransfersTest-1874872304 None] Created reservations ['d9df817c-e21f-4071-9296-f77f75ad9d17', '7990cac2-a807-4aea-a620-f31b9ffcb618', 'b221ea5d-f49d-447a-90d1-6eb4412ca097', '11dbe3fa-1def-4d37-a2f4-9b1255a3af28'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:16:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c635bf03-70f9-4f10-a5a5-5380e055d932 tempest-VolumesTransfersTest-1874872304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:16:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c635bf03-70f9-4f10-a5a5-5380e055d932 tempest-VolumesTransfersTest-1874872304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:16:34 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c635bf03-70f9-4f10-a5a5-5380e055d932 tempest-VolumesTransfersTest-1874872304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:16:34 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c635bf03-70f9-4f10-a5a5-5380e055d932 tempest-VolumesTransfersTest-1874872304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:16:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c635bf03-70f9-4f10-a5a5-5380e055d932 tempest-VolumesTransfersTest-1874872304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:16:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c635bf03-70f9-4f10-a5a5-5380e055d932 tempest-VolumesTransfersTest-1874872304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:34 devstack sudo[97440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:16:34 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:34 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-07b06e37-1ee7-41c0-b62d-a587809420ad tempest-AttachVolumeTestJSON-309313673 None] Acquiring lock "cinder-656e91ea-cf57-4638-b996-6fc70bc2ce8a-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:16:34 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-07b06e37-1ee7-41c0-b62d-a587809420ad tempest-AttachVolumeTestJSON-309313673 None] Lock "cinder-656e91ea-cf57-4638-b996-6fc70bc2ce8a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:16:34 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-07b06e37-1ee7-41c0-b62d-a587809420ad tempest-AttachVolumeTestJSON-309313673 None] Acquiring lock "cinder-quobyte-656e91ea-cf57-4638-b996-6fc70bc2ce8a" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:16:34 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-07b06e37-1ee7-41c0-b62d-a587809420ad tempest-AttachVolumeTestJSON-309313673 None] Lock "cinder-quobyte-656e91ea-cf57-4638-b996-6fc70bc2ce8a" acquired by "delete_volume" :: waited 0.023s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:16:34 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61d73d5-7202-4082-9f73-7ae2b1c04843]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:16:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-07b06e37-1ee7-41c0-b62d-a587809420ad tempest-AttachVolumeTestJSON-309313673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-656e91ea-cf57-4638-b996-6fc70bc2ce8a {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:35 devstack sudo[97442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-656e91ea-cf57-4638-b996-6fc70bc2ce8a Jul 10 18:16:35 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:35 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c635bf03-70f9-4f10-a5a5-5380e055d932 tempest-VolumesTransfersTest-1874872304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.101s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:35 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-c635bf03-70f9-4f10-a5a5-5380e055d932 tempest-VolumesTransfersTest-1874872304 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:16:35 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-c635bf03-70f9-4f10-a5a5-5380e055d932 tempest-VolumesTransfersTest-1874872304 None] Deleted volume successfully. Jul 10 18:16:35 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c635bf03-70f9-4f10-a5a5-5380e055d932 tempest-VolumesTransfersTest-1874872304 None] Lock "cinder-4ae8d6a4-43a0-4b11-8b3e-2e541a42dbdd-delete_volume" released by "delete_volume" :: held 3.231s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:16:36 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-07b06e37-1ee7-41c0-b62d-a587809420ad tempest-AttachVolumeTestJSON-309313673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-656e91ea-cf57-4638-b996-6fc70bc2ce8a" returned: 0 in 1.432s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-07b06e37-1ee7-41c0-b62d-a587809420ad tempest-AttachVolumeTestJSON-309313673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-656e91ea-cf57-4638-b996-6fc70bc2ce8a {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:36 devstack sudo[97449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-656e91ea-cf57-4638-b996-6fc70bc2ce8a Jul 10 18:16:36 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:37 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-07b06e37-1ee7-41c0-b62d-a587809420ad tempest-AttachVolumeTestJSON-309313673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-656e91ea-cf57-4638-b996-6fc70bc2ce8a" returned: 0 in 0.998s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:37 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-07b06e37-1ee7-41c0-b62d-a587809420ad tempest-AttachVolumeTestJSON-309313673 None] Lock "cinder-quobyte-656e91ea-cf57-4638-b996-6fc70bc2ce8a" released by "delete_volume" :: held 2.498s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:16:37 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-07b06e37-1ee7-41c0-b62d-a587809420ad tempest-AttachVolumeTestJSON-309313673 None] Created reservations ['bdd2b7c7-a41f-4464-9e55-6cdb62cbbb43', '91e01e22-51d1-4b97-818d-3be8eef4a262', '1c8215ed-93e6-4cd8-8809-e30e593cf2e1', '8de8dc39-04ba-48f0-b040-be689794ea1e'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:16:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-07b06e37-1ee7-41c0-b62d-a587809420ad tempest-AttachVolumeTestJSON-309313673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:16:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-07b06e37-1ee7-41c0-b62d-a587809420ad tempest-AttachVolumeTestJSON-309313673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:16:37 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-07b06e37-1ee7-41c0-b62d-a587809420ad tempest-AttachVolumeTestJSON-309313673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:16:37 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-07b06e37-1ee7-41c0-b62d-a587809420ad tempest-AttachVolumeTestJSON-309313673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:16:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-07b06e37-1ee7-41c0-b62d-a587809420ad tempest-AttachVolumeTestJSON-309313673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:16:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-07b06e37-1ee7-41c0-b62d-a587809420ad tempest-AttachVolumeTestJSON-309313673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:37 devstack sudo[97468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:16:37 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:38 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-07b06e37-1ee7-41c0-b62d-a587809420ad tempest-AttachVolumeTestJSON-309313673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.858s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:38 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-07b06e37-1ee7-41c0-b62d-a587809420ad tempest-AttachVolumeTestJSON-309313673 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:16:38 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-07b06e37-1ee7-41c0-b62d-a587809420ad tempest-AttachVolumeTestJSON-309313673 None] Deleted volume successfully. Jul 10 18:16:38 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-07b06e37-1ee7-41c0-b62d-a587809420ad tempest-AttachVolumeTestJSON-309313673 None] Lock "cinder-656e91ea-cf57-4638-b996-6fc70bc2ce8a-delete_volume" released by "delete_volume" :: held 3.670s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:16:38 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-fe4644c6-954f-4b97-94e9-37c79732a4c9 tempest-AttachVolumeTestJSON-309313673 None] Acquiring lock "cinder-cbd606b2-9c33-4116-83f5-6968474061b8-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:16:38 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-fe4644c6-954f-4b97-94e9-37c79732a4c9 tempest-AttachVolumeTestJSON-309313673 None] Lock "cinder-cbd606b2-9c33-4116-83f5-6968474061b8-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:16:38 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-fe4644c6-954f-4b97-94e9-37c79732a4c9 tempest-AttachVolumeTestJSON-309313673 None] Acquiring lock "cinder-quobyte-cbd606b2-9c33-4116-83f5-6968474061b8" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:16:38 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-fe4644c6-954f-4b97-94e9-37c79732a4c9 tempest-AttachVolumeTestJSON-309313673 None] Lock "cinder-quobyte-cbd606b2-9c33-4116-83f5-6968474061b8" acquired by "delete_volume" :: waited 0.024s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:16:38 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[73de1c83-4203-48ea-9441-8d1aeeaeb316]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:16:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fe4644c6-954f-4b97-94e9-37c79732a4c9 tempest-AttachVolumeTestJSON-309313673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-cbd606b2-9c33-4116-83f5-6968474061b8 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:39 devstack sudo[97472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-cbd606b2-9c33-4116-83f5-6968474061b8 Jul 10 18:16:39 devstack sudo[97472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:39 devstack sudo[97472]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fe4644c6-954f-4b97-94e9-37c79732a4c9 tempest-AttachVolumeTestJSON-309313673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-cbd606b2-9c33-4116-83f5-6968474061b8" returned: 0 in 0.903s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fe4644c6-954f-4b97-94e9-37c79732a4c9 tempest-AttachVolumeTestJSON-309313673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-cbd606b2-9c33-4116-83f5-6968474061b8 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:39 devstack sudo[97478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-cbd606b2-9c33-4116-83f5-6968474061b8 Jul 10 18:16:39 devstack sudo[97478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:40 devstack sudo[97478]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fe4644c6-954f-4b97-94e9-37c79732a4c9 tempest-AttachVolumeTestJSON-309313673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-cbd606b2-9c33-4116-83f5-6968474061b8" returned: 0 in 0.862s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:40 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-fe4644c6-954f-4b97-94e9-37c79732a4c9 tempest-AttachVolumeTestJSON-309313673 None] Lock "cinder-quobyte-cbd606b2-9c33-4116-83f5-6968474061b8" released by "delete_volume" :: held 1.822s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:16:40 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-fe4644c6-954f-4b97-94e9-37c79732a4c9 tempest-AttachVolumeTestJSON-309313673 None] Created reservations ['ed9bb96d-ac9f-499e-94cb-b26e8f045340', '81140eb0-fc89-46f5-bbc0-ac3c3f5c4c8a', '4cf2da71-4dce-4e23-8629-d6cbfa314089', '3d0bb286-5a50-40af-9a51-77385a423481'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:16:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-fe4644c6-954f-4b97-94e9-37c79732a4c9 tempest-AttachVolumeTestJSON-309313673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:16:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-fe4644c6-954f-4b97-94e9-37c79732a4c9 tempest-AttachVolumeTestJSON-309313673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:16:40 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-fe4644c6-954f-4b97-94e9-37c79732a4c9 tempest-AttachVolumeTestJSON-309313673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:16:40 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-fe4644c6-954f-4b97-94e9-37c79732a4c9 tempest-AttachVolumeTestJSON-309313673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:16:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-fe4644c6-954f-4b97-94e9-37c79732a4c9 tempest-AttachVolumeTestJSON-309313673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:16:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fe4644c6-954f-4b97-94e9-37c79732a4c9 tempest-AttachVolumeTestJSON-309313673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:40 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:16:40 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:41 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fe4644c6-954f-4b97-94e9-37c79732a4c9 tempest-AttachVolumeTestJSON-309313673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.860s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:41 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-fe4644c6-954f-4b97-94e9-37c79732a4c9 tempest-AttachVolumeTestJSON-309313673 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:16:41 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-fe4644c6-954f-4b97-94e9-37c79732a4c9 tempest-AttachVolumeTestJSON-309313673 None] Deleted volume successfully. Jul 10 18:16:41 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-fe4644c6-954f-4b97-94e9-37c79732a4c9 tempest-AttachVolumeTestJSON-309313673 None] Lock "cinder-cbd606b2-9c33-4116-83f5-6968474061b8-delete_volume" released by "delete_volume" :: held 2.961s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:16:45 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:16:45 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] Flow 'volume_create_manager' (2f771a2b-d530-4094-8196-4b13ea3e1872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:16:45 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb469721-030b-4cd3-af81-2ab3bc755b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:45 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb469721-030b-4cd3-af81-2ab3bc755b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1661374745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f0e1e5-71f9-4336-acef-fb40e35bc591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='220ef9a64fbb4a6994dcf47ac2f02466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:16:45Z,use_quota=True,user_id='4c63268934fb477db3cd78e82c7eac22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:45 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1d458b8-257c-49c8-ba8d-0dc8a37a2d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:45 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1d458b8-257c-49c8-ba8d-0dc8a37a2d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:45 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03cc2cbb-132b-42ba-92a3-fc2bba3b4bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:45 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03cc2cbb-132b-42ba-92a3-fc2bba3b4bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13f0e1e5-71f9-4336-acef-fb40e35bc591', 'volume_name': 'volume-13f0e1e5-71f9-4336-acef-fb40e35bc591', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:45 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a507127-18d4-458e-ba0e-62fa7bb77be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:45 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a507127-18d4-458e-ba0e-62fa7bb77be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:45 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91eb51d3-9522-4893-86c8-67720a934ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:45 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] Volume 13f0e1e5-71f9-4336-acef-fb40e35bc591: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13f0e1e5-71f9-4336-acef-fb40e35bc591', 'volume_size': 1} Jul 10 18:16:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:16:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:16:45 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1661374745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f0e1e5-71f9-4336-acef-fb40e35bc591,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='220ef9a64fbb4a6994dcf47ac2f02466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:16:45Z,use_quota=True,user_id='4c63268934fb477db3cd78e82c7eac22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:16:45 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] Creating volume 13f0e1e5-71f9-4336-acef-fb40e35bc591 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:16:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:16:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:16:45 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:16:45 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:16:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:16:45 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:16:45 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:16:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-13f0e1e5-71f9-4336-acef-fb40e35bc591 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:45 devstack sudo[97521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-13f0e1e5-71f9-4336-acef-fb40e35bc591 1073741824 Jul 10 18:16:45 devstack sudo[97521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:46 devstack sudo[97521]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-13f0e1e5-71f9-4336-acef-fb40e35bc591 1073741824" returned: 0 in 1.632s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-13f0e1e5-71f9-4336-acef-fb40e35bc591 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:47 devstack sudo[97573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-13f0e1e5-71f9-4336-acef-fb40e35bc591 Jul 10 18:16:47 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:47 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-13f0e1e5-71f9-4336-acef-fb40e35bc591" returned: 0 in 1.010s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:48 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] <== create_volume: return (2704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:16:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.707s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:16:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91eb51d3-9522-4893-86c8-67720a934ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13f0e1e5-71f9-4336-acef-fb40e35bc591', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e95ff8-e84f-4991-ad94-773d781228dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:48 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] Volume volume-13f0e1e5-71f9-4336-acef-fb40e35bc591 (13f0e1e5-71f9-4336-acef-fb40e35bc591): created successfully Jul 10 18:16:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e95ff8-e84f-4991-ad94-773d781228dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] Flow 'volume_create_manager' (2f771a2b-d530-4094-8196-4b13ea3e1872) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:16:48 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-7b6c750d-f0e2-49ca-bc7b-115539de58f5 tempest-VolumesTransfersV355Test-1804286243 None] Created volume successfully. Jul 10 18:16:49 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-b5fdbd10-6407-43c5-aa9b-54c563e6e404 tempest-VolumesTransfersV355Test-512048113 None] Transfer volume completed successfully. Jul 10 18:16:51 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-de165372-c7f3-48ba-b768-f37fb2ac69ff tempest-VolumesTransfersV355Test-1157728887 None] Acquiring lock "cinder-13f0e1e5-71f9-4336-acef-fb40e35bc591-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:16:51 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-de165372-c7f3-48ba-b768-f37fb2ac69ff tempest-VolumesTransfersV355Test-1157728887 None] Lock "cinder-13f0e1e5-71f9-4336-acef-fb40e35bc591-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:16:51 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=91,cinder:DELETE=11,cinder:INSERT=30,cinder:UPDATE=117 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:16:51 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=97,cinder:UPDATE=110,cinder:INSERT=26,cinder:DELETE=7 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:16:51 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-de165372-c7f3-48ba-b768-f37fb2ac69ff tempest-VolumesTransfersV355Test-1157728887 None] Acquiring lock "cinder-quobyte-13f0e1e5-71f9-4336-acef-fb40e35bc591" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:16:51 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-de165372-c7f3-48ba-b768-f37fb2ac69ff tempest-VolumesTransfersV355Test-1157728887 None] Lock "cinder-quobyte-13f0e1e5-71f9-4336-acef-fb40e35bc591" acquired by "delete_volume" :: waited 0.027s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:16:51 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57ce4e2-ced0-4581-85fe-8a2cb4edc592]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:16:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-de165372-c7f3-48ba-b768-f37fb2ac69ff tempest-VolumesTransfersV355Test-1157728887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-13f0e1e5-71f9-4336-acef-fb40e35bc591 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:51 devstack sudo[97598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-13f0e1e5-71f9-4336-acef-fb40e35bc591 Jul 10 18:16:51 devstack sudo[97598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:53 devstack sudo[97598]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-de165372-c7f3-48ba-b768-f37fb2ac69ff tempest-VolumesTransfersV355Test-1157728887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-13f0e1e5-71f9-4336-acef-fb40e35bc591" returned: 0 in 1.543s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-de165372-c7f3-48ba-b768-f37fb2ac69ff tempest-VolumesTransfersV355Test-1157728887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-13f0e1e5-71f9-4336-acef-fb40e35bc591 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:53 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-13f0e1e5-71f9-4336-acef-fb40e35bc591 Jul 10 18:16:53 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:54 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-de165372-c7f3-48ba-b768-f37fb2ac69ff tempest-VolumesTransfersV355Test-1157728887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-13f0e1e5-71f9-4336-acef-fb40e35bc591" returned: 0 in 1.081s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:54 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-de165372-c7f3-48ba-b768-f37fb2ac69ff tempest-VolumesTransfersV355Test-1157728887 None] Lock "cinder-quobyte-13f0e1e5-71f9-4336-acef-fb40e35bc591" released by "delete_volume" :: held 2.720s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:16:54 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-de165372-c7f3-48ba-b768-f37fb2ac69ff tempest-VolumesTransfersV355Test-1157728887 None] Created reservations ['5d1373fd-20a9-4061-ab32-50af006a2e70', '0348f8d1-e019-468b-9a42-75ab8fecf71c', '70f35d87-4b1a-4eff-9c55-5b3215992cd8', '1e90d6be-1dd9-4bdc-8452-5847c697d4e9'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:16:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-de165372-c7f3-48ba-b768-f37fb2ac69ff tempest-VolumesTransfersV355Test-1157728887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:16:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-de165372-c7f3-48ba-b768-f37fb2ac69ff tempest-VolumesTransfersV355Test-1157728887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:16:54 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-de165372-c7f3-48ba-b768-f37fb2ac69ff tempest-VolumesTransfersV355Test-1157728887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:16:54 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-de165372-c7f3-48ba-b768-f37fb2ac69ff tempest-VolumesTransfersV355Test-1157728887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:16:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-de165372-c7f3-48ba-b768-f37fb2ac69ff tempest-VolumesTransfersV355Test-1157728887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:16:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-de165372-c7f3-48ba-b768-f37fb2ac69ff tempest-VolumesTransfersV355Test-1157728887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:54 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:16:54 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:55 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-de165372-c7f3-48ba-b768-f37fb2ac69ff tempest-VolumesTransfersV355Test-1157728887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.248s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:55 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-de165372-c7f3-48ba-b768-f37fb2ac69ff tempest-VolumesTransfersV355Test-1157728887 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:16:55 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-de165372-c7f3-48ba-b768-f37fb2ac69ff tempest-VolumesTransfersV355Test-1157728887 None] Deleted volume successfully. Jul 10 18:16:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-de165372-c7f3-48ba-b768-f37fb2ac69ff tempest-VolumesTransfersV355Test-1157728887 None] Lock "cinder-13f0e1e5-71f9-4336-acef-fb40e35bc591-delete_volume" released by "delete_volume" :: held 4.359s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:16:55 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:16:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] Flow 'volume_create_manager' (af6d7b8f-900b-4146-94e9-87fe14724af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:16:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee05d8b-e54c-4ae6-a3b7-5c43210a8d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee05d8b-e54c-4ae6-a3b7-5c43210a8d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1878177869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55a7972f-5172-4562-91ac-70eec4f1c0e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='220ef9a64fbb4a6994dcf47ac2f02466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:16:56Z,use_quota=True,user_id='4c63268934fb477db3cd78e82c7eac22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a25e24-f45b-4fa9-abfb-4f1330357f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a25e24-f45b-4fa9-abfb-4f1330357f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5244048e-23b5-45ce-8788-92fa7fcc83a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5244048e-23b5-45ce-8788-92fa7fcc83a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55a7972f-5172-4562-91ac-70eec4f1c0e2', 'volume_name': 'volume-55a7972f-5172-4562-91ac-70eec4f1c0e2', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (addf9bcf-2309-414b-84f7-0b0d5106f92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (addf9bcf-2309-414b-84f7-0b0d5106f92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:56 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c6cf07b-5b3f-403b-b6e9-43c88089d0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:56 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] Volume 55a7972f-5172-4562-91ac-70eec4f1c0e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55a7972f-5172-4562-91ac-70eec4f1c0e2', 'volume_size': 1} Jul 10 18:16:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:16:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:16:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1878177869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55a7972f-5172-4562-91ac-70eec4f1c0e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='220ef9a64fbb4a6994dcf47ac2f02466',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:16:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:16:56Z,use_quota=True,user_id='4c63268934fb477db3cd78e82c7eac22',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:16:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] Creating volume 55a7972f-5172-4562-91ac-70eec4f1c0e2 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:16:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:16:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:16:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:16:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:16:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:16:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:16:56 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:16:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-55a7972f-5172-4562-91ac-70eec4f1c0e2 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:56 devstack sudo[97616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-55a7972f-5172-4562-91ac-70eec4f1c0e2 1073741824 Jul 10 18:16:56 devstack sudo[97616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:57 devstack sudo[97616]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-55a7972f-5172-4562-91ac-70eec4f1c0e2 1073741824" returned: 0 in 1.446s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:57 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:16:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:16:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:16:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:16:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:16:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:16:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-55a7972f-5172-4562-91ac-70eec4f1c0e2 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:57 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:16:57 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:57 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-55a7972f-5172-4562-91ac-70eec4f1c0e2 Jul 10 18:16:57 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:58 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:16:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] Flow 'volume_create_manager' (df4a9247-3b8c-45dc-8e17-59799ff09f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:16:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a980377-5b20-4eae-909d-37e89e2e9554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a980377-5b20-4eae-909d-37e89e2e9554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1506339011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf5eec32-9a07-426d-9610-f903cb6f29d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e32b386a157441d98715617717964267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:16:58Z,use_quota=True,user_id='5f466aa26fa142f39faf442edd7b7e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c3b246-005f-414f-9220-2d656c6991fd),volume_type_id=47c3b246-005f-414f-9220-2d656c6991fd)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:58 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c1603f-8987-4ed7-af4d-c26d8a903c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02c1603f-8987-4ed7-af4d-c26d8a903c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c07586-a20b-47df-8a06-bb6f6fd6709b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c07586-a20b-47df-8a06-bb6f6fd6709b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf5eec32-9a07-426d-9610-f903cb6f29d3', 'volume_name': 'volume-bf5eec32-9a07-426d-9610-f903cb6f29d3', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cdb5091-3d0c-4bbe-9d38-136ab89027d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cdb5091-3d0c-4bbe-9d38-136ab89027d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae8c7ea-88da-4b47-becd-bf1ac906de2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:58 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] Volume bf5eec32-9a07-426d-9610-f903cb6f29d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf5eec32-9a07-426d-9610-f903cb6f29d3', 'volume_size': 1} Jul 10 18:16:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:16:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-55a7972f-5172-4562-91ac-70eec4f1c0e2" returned: 0 in 1.301s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] <== create_volume: return (2862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:16:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.867s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:16:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.017s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:16:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1506339011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf5eec32-9a07-426d-9610-f903cb6f29d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e32b386a157441d98715617717964267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:16:58Z,use_quota=True,user_id='5f466aa26fa142f39faf442edd7b7e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47c3b246-005f-414f-9220-2d656c6991fd),volume_type_id=47c3b246-005f-414f-9220-2d656c6991fd)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:16:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] Creating volume bf5eec32-9a07-426d-9610-f903cb6f29d3 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:16:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:16:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:16:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:16:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:16:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:16:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:16:58 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:16:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf5eec32-9a07-426d-9610-f903cb6f29d3 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:16:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c6cf07b-5b3f-403b-b6e9-43c88089d0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55a7972f-5172-4562-91ac-70eec4f1c0e2', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2051239b-ffc1-4940-96c3-6087681ddde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:59 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] Volume volume-55a7972f-5172-4562-91ac-70eec4f1c0e2 (55a7972f-5172-4562-91ac-70eec4f1c0e2): created successfully Jul 10 18:16:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2051239b-ffc1-4940-96c3-6087681ddde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] Flow 'volume_create_manager' (af6d7b8f-900b-4146-94e9-87fe14724af8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:16:59 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf5eec32-9a07-426d-9610-f903cb6f29d3 1073741824 Jul 10 18:16:59 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:16:59 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-d23894c8-03c7-45e5-9f7f-9d43dc97a2bf tempest-VolumesTransfersV355Test-1804286243 None] Created volume successfully. Jul 10 18:16:59 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Jul 10 18:16:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 2.085s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:16:59 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:16:59 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager._thread_info {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:16:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread count: 28 {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 18:16:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread info: [<_MainThread(MainThread, started 139757428633728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 18:16:59 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:16:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] Flow 'volume_create_manager' (1521e22a-0bad-4815-ad89-1afab65f37f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:16:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (242f8b99-bfec-4c99-9f20-78caae36960f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (242f8b99-bfec-4c99-9f20-78caae36960f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-607252371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fee5fdc9-f34d-4cee-bf2d-77bb3088e995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e32b386a157441d98715617717964267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:17:00Z,use_quota=True,user_id='5f466aa26fa142f39faf442edd7b7e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f06f630-0c57-4605-b255-6776d5ca6166),volume_type_id=8f06f630-0c57-4605-b255-6776d5ca6166)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed1c76c9-85d3-48a6-9d61-e05124a2cc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed1c76c9-85d3-48a6-9d61-e05124a2cc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65af79c5-0ff4-4b15-8f8e-5ecb1670cdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65af79c5-0ff4-4b15-8f8e-5ecb1670cdfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fee5fdc9-f34d-4cee-bf2d-77bb3088e995', 'volume_name': 'volume-fee5fdc9-f34d-4cee-bf2d-77bb3088e995', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca7b74a-6689-4de2-9afe-afef5faa6521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca7b74a-6689-4de2-9afe-afef5faa6521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:16:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed3077c-24d0-4189-8192-b8067eea7ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:16:59 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] Volume fee5fdc9-f34d-4cee-bf2d-77bb3088e995: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fee5fdc9-f34d-4cee-bf2d-77bb3088e995', 'volume_size': 1} Jul 10 18:16:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:17:00 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:17:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Flow 'volume_create_manager' (3b0ec4fe-14dc-4fa6-bd14-b3169963c172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:17:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c0d8c22-eed1-4e27-9caf-33c32479ca08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:00 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf5eec32-9a07-426d-9610-f903cb6f29d3 1073741824" returned: 0 in 1.581s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c0d8c22-eed1-4e27-9caf-33c32479ca08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-170411184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73335b52-40f0-4728-b820-e7250c8323d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e32b386a157441d98715617717964267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:17:00Z,use_quota=True,user_id='5f466aa26fa142f39faf442edd7b7e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24d904f2-c1a7-4eb5-be87-2974958794af),volume_type_id=24d904f2-c1a7-4eb5-be87-2974958794af)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46fdc0d2-9087-4e7c-b4c2-346c0cb43f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46fdc0d2-9087-4e7c-b4c2-346c0cb43f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b851c29-a428-427e-b75c-02dfc7d8abf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:00 devstack cinder-volume[87399]: DEBUG cinder.image.glance [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Creating Keystone auth plugin from conf {{(pid=87399) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 18:17:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf5eec32-9a07-426d-9610-f903cb6f29d3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:00 devstack sudo[97640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf5eec32-9a07-426d-9610-f903cb6f29d3 Jul 10 18:17:00 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:00 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-29a1c41a-5bf0-4449-a981-bbefc64c6723 tempest-VolumesTransfersV355Test-1157728887 None] Acquiring lock "cinder-55a7972f-5172-4562-91ac-70eec4f1c0e2-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:17:00 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-29a1c41a-5bf0-4449-a981-bbefc64c6723 tempest-VolumesTransfersV355Test-1157728887 None] Lock "cinder-55a7972f-5172-4562-91ac-70eec4f1c0e2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:17:00 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-29a1c41a-5bf0-4449-a981-bbefc64c6723 tempest-VolumesTransfersV355Test-1157728887 None] Acquiring lock "cinder-quobyte-55a7972f-5172-4562-91ac-70eec4f1c0e2" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:17:00 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-29a1c41a-5bf0-4449-a981-bbefc64c6723 tempest-VolumesTransfersV355Test-1157728887 None] Lock "cinder-quobyte-55a7972f-5172-4562-91ac-70eec4f1c0e2" acquired by "delete_volume" :: waited 0.047s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:17:01 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[06bc1063-842a-4b5a-bcf7-bf76be1da387]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:17:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-29a1c41a-5bf0-4449-a981-bbefc64c6723 tempest-VolumesTransfersV355Test-1157728887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-55a7972f-5172-4562-91ac-70eec4f1c0e2 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b851c29-a428-427e-b75c-02dfc7d8abf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '73335b52-40f0-4728-b820-e7250c8323d6', 'volume_name': 'volume-73335b52-40f0-4728-b820-e7250c8323d6', 'volume_size': 1, 'image_id': 'f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--835927608', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e32b386a157441d98715617717964267', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3', 'created_at': datetime.datetime(2026, 7, 10, 16, 16, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 16, 16, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3/file', 'properties': {}}, 'image_service': }' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (241146bd-3a2b-4f57-8882-b40242f23fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (241146bd-3a2b-4f57-8882-b40242f23fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dc87d1c-65f4-4c8d-a097-a31780c5840c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:01 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Volume 73335b52-40f0-4728-b820-e7250c8323d6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-73335b52-40f0-4728-b820-e7250c8323d6', 'volume_size': 1, 'image_id': 'f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--835927608', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e32b386a157441d98715617717964267', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3', 'created_at': datetime.datetime(2026, 7, 10, 16, 16, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 16, 16, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3/file', 'properties': {}}, 'image_service': } Jul 10 18:17:01 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Trying to clone 73335b52-40f0-4728-b820-e7250c8323d6 from image f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3', 'metadata': {}}]). {{(pid=87399) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 18:17:01 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-55a7972f-5172-4562-91ac-70eec4f1c0e2 Jul 10 18:17:01 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:01 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf5eec32-9a07-426d-9610-f903cb6f29d3" returned: 0 in 1.249s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:01 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] <== create_volume: return (2983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:17:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.988s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:17:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.073s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:17:01 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-607252371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fee5fdc9-f34d-4cee-bf2d-77bb3088e995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e32b386a157441d98715617717964267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:17:00Z,use_quota=True,user_id='5f466aa26fa142f39faf442edd7b7e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f06f630-0c57-4605-b255-6776d5ca6166),volume_type_id=8f06f630-0c57-4605-b255-6776d5ca6166)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:17:01 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] Creating volume fee5fdc9-f34d-4cee-bf2d-77bb3088e995 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:17:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:17:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:17:01 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:17:01 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:17:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:17:01 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:17:01 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:17:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fee5fdc9-f34d-4cee-bf2d-77bb3088e995 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ae8c7ea-88da-4b47-becd-bf1ac906de2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf5eec32-9a07-426d-9610-f903cb6f29d3', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be656cf3-a832-4299-b334-b64dbcb8c713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:01 devstack sudo[97666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fee5fdc9-f34d-4cee-bf2d-77bb3088e995 1073741824 Jul 10 18:17:01 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:01 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] Volume volume-bf5eec32-9a07-426d-9610-f903cb6f29d3 (bf5eec32-9a07-426d-9610-f903cb6f29d3): created successfully Jul 10 18:17:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be656cf3-a832-4299-b334-b64dbcb8c713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] Flow 'volume_create_manager' (df4a9247-3b8c-45dc-8e17-59799ff09f95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:17:01 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-048b7d72-6e2c-4bfd-8b13-cdee56ba9870 tempest-TestInstancesWithCinderVolumes-348398060 None] Created volume successfully. Jul 10 18:17:02 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-29a1c41a-5bf0-4449-a981-bbefc64c6723 tempest-VolumesTransfersV355Test-1157728887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-55a7972f-5172-4562-91ac-70eec4f1c0e2" returned: 0 in 1.376s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-29a1c41a-5bf0-4449-a981-bbefc64c6723 tempest-VolumesTransfersV355Test-1157728887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-55a7972f-5172-4562-91ac-70eec4f1c0e2 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:02 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-55a7972f-5172-4562-91ac-70eec4f1c0e2 Jul 10 18:17:02 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:02 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fee5fdc9-f34d-4cee-bf2d-77bb3088e995 1073741824" returned: 0 in 1.034s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fee5fdc9-f34d-4cee-bf2d-77bb3088e995 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:02 devstack sudo[97678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fee5fdc9-f34d-4cee-bf2d-77bb3088e995 Jul 10 18:17:02 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:03 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-29a1c41a-5bf0-4449-a981-bbefc64c6723 tempest-VolumesTransfersV355Test-1157728887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-55a7972f-5172-4562-91ac-70eec4f1c0e2" returned: 0 in 0.858s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:03 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-29a1c41a-5bf0-4449-a981-bbefc64c6723 tempest-VolumesTransfersV355Test-1157728887 None] Lock "cinder-quobyte-55a7972f-5172-4562-91ac-70eec4f1c0e2" released by "delete_volume" :: held 2.308s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:17:03 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-29a1c41a-5bf0-4449-a981-bbefc64c6723 tempest-VolumesTransfersV355Test-1157728887 None] Created reservations ['a6ca76b5-5e4e-4750-a54d-7f7425597f8a', 'eb4640df-0d58-49b5-8b7a-478b970258d1', '28a3cff6-a0a0-45ee-872c-6c1661d46203', '68fa9db6-a13a-4c51-a455-6b255cfff330'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:17:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-29a1c41a-5bf0-4449-a981-bbefc64c6723 tempest-VolumesTransfersV355Test-1157728887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:17:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-29a1c41a-5bf0-4449-a981-bbefc64c6723 tempest-VolumesTransfersV355Test-1157728887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:17:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-29a1c41a-5bf0-4449-a981-bbefc64c6723 tempest-VolumesTransfersV355Test-1157728887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:17:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-29a1c41a-5bf0-4449-a981-bbefc64c6723 tempest-VolumesTransfersV355Test-1157728887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:17:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-29a1c41a-5bf0-4449-a981-bbefc64c6723 tempest-VolumesTransfersV355Test-1157728887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:17:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-29a1c41a-5bf0-4449-a981-bbefc64c6723 tempest-VolumesTransfersV355Test-1157728887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:03 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:17:03 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:03 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fee5fdc9-f34d-4cee-bf2d-77bb3088e995" returned: 0 in 0.865s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] <== create_volume: return (1946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:17:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.949s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:17:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed3077c-24d0-4189-8192-b8067eea7ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fee5fdc9-f34d-4cee-bf2d-77bb3088e995', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73690d60-d608-4595-ae50-94044d0c191a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:03 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] Volume volume-fee5fdc9-f34d-4cee-bf2d-77bb3088e995 (fee5fdc9-f34d-4cee-bf2d-77bb3088e995): created successfully Jul 10 18:17:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73690d60-d608-4595-ae50-94044d0c191a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] Flow 'volume_create_manager' (1521e22a-0bad-4815-ad89-1afab65f37f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:17:03 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-8c1d6786-5411-4670-b7dd-7b8f1f4f428f tempest-TestInstancesWithCinderVolumes-348398060 None] Created volume successfully. Jul 10 18:17:04 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-29a1c41a-5bf0-4449-a981-bbefc64c6723 tempest-VolumesTransfersV355Test-1157728887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.801s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:04 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-29a1c41a-5bf0-4449-a981-bbefc64c6723 tempest-VolumesTransfersV355Test-1157728887 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:17:04 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-29a1c41a-5bf0-4449-a981-bbefc64c6723 tempest-VolumesTransfersV355Test-1157728887 None] Deleted volume successfully. Jul 10 18:17:04 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-29a1c41a-5bf0-4449-a981-bbefc64c6723 tempest-VolumesTransfersV355Test-1157728887 None] Lock "cinder-55a7972f-5172-4562-91ac-70eec4f1c0e2-delete_volume" released by "delete_volume" :: held 3.458s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:17:05 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3_5sutn94kdevstack@QuobyteHD, size 20.69 MB, duration 4.04 sec {{(pid=87399) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 18:17:05 devstack cinder-volume[87399]: INFO cinder.image.image_utils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Image download 20.69 MB at 5.12 MB/s Jul 10 18:17:05 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[025d3ce4-6490-4007-901d-080849ea8f11]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:17:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3_5sutn94kdevstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:05 devstack sudo[97685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3_5sutn94kdevstack@QuobyteHD Jul 10 18:17:05 devstack sudo[97685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:06 devstack sudo[97685]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3_5sutn94kdevstack@QuobyteHD" returned: 0 in 0.738s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:06 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Temporary image f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3 is fetched for user 5f466aa26fa142f39faf442edd7b7e46. {{(pid=87399) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 18:17:06 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d837517-3d6d-4e90-a9e2-f5bd5e57f038]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:17:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3_5sutn94kdevstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:06 devstack sudo[97691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3_5sutn94kdevstack@QuobyteHD Jul 10 18:17:06 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:06 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3_5sutn94kdevstack@QuobyteHD" returned: 0 in 0.867s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:17:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:17:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-170411184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73335b52-40f0-4728-b820-e7250c8323d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e32b386a157441d98715617717964267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:17:00Z,use_quota=True,user_id='5f466aa26fa142f39faf442edd7b7e46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24d904f2-c1a7-4eb5-be87-2974958794af),volume_type_id=24d904f2-c1a7-4eb5-be87-2974958794af)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:17:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Creating volume 73335b52-40f0-4728-b820-e7250c8323d6 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:17:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:17:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:17:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:17:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:17:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:17:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:17:06 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:17:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:07 devstack sudo[97696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6 1073741824 Jul 10 18:17:07 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:08 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6 1073741824" returned: 0 in 1.038s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:08 devstack sudo[97702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6 Jul 10 18:17:08 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:08 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6" returned: 0 in 0.747s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] <== create_volume: return (1856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:17:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.859s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:17:08 devstack cinder-volume[87399]: DEBUG cinder.volume.volume_utils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Attempting download of f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3 ((None, [{'url': 'file:///opt/stack/data/glance/images/f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3', 'metadata': {}}])) to volume 73335b52-40f0-4728-b820-e7250c8323d6. {{(pid=87399) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 18:17:08 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[591b4535-a560-46d3-a0da-07692c537f5f]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:17:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3_8vcjtwud {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:09 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3_8vcjtwud Jul 10 18:17:09 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:09 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3_8vcjtwud" returned: 0 in 0.925s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3_8vcjtwud {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:10 devstack sudo[97709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3_8vcjtwud Jul 10 18:17:10 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:10 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3_8vcjtwud" returned: 1 in 0.867s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3_8vcjtwud' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:17:10 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54ebf96-27eb-45b8-880a-6b831b255d4c]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:17:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3_5sutn94kdevstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:10 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3_5sutn94kdevstack@QuobyteHD Jul 10 18:17:10 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:11 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:17:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] Flow 'volume_create_manager' (b24ac05c-65ff-4aaa-a840-a9f670305577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:17:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e785f7-0f63-49db-9677-ac8e9aedfd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e785f7-0f63-49db-9677-ac8e9aedfd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-253602138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e632463-8d19-4d7f-bc5b-ed5080ad6267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d3a1c77994463a801dc9f115355384',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:17:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:17:11Z,use_quota=True,user_id='369a090ba0f249aab2b11ddc1bd6cb71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3412681-a1ed-44e7-a61c-18e9f416ba65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3412681-a1ed-44e7-a61c-18e9f416ba65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c367fc5-eabf-4dc3-89c8-ea396076a702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c367fc5-eabf-4dc3-89c8-ea396076a702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e632463-8d19-4d7f-bc5b-ed5080ad6267', 'volume_name': 'volume-9e632463-8d19-4d7f-bc5b-ed5080ad6267', 'volume_size': 2}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2cbccb9-a3ac-48cb-96fb-9d23bc09cd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2cbccb9-a3ac-48cb-96fb-9d23bc09cd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e77d196-c443-416b-aabf-3f88b7c831f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:11 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] Volume 9e632463-8d19-4d7f-bc5b-ed5080ad6267: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e632463-8d19-4d7f-bc5b-ed5080ad6267', 'volume_size': 2} Jul 10 18:17:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:17:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:17:11 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-253602138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e632463-8d19-4d7f-bc5b-ed5080ad6267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d3a1c77994463a801dc9f115355384',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:17:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:17:11Z,use_quota=True,user_id='369a090ba0f249aab2b11ddc1bd6cb71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:17:11 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] Creating volume 9e632463-8d19-4d7f-bc5b-ed5080ad6267 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:17:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:17:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:17:11 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:17:11 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:17:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:17:11 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:17:11 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:17:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9e632463-8d19-4d7f-bc5b-ed5080ad6267 2147483648 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:11 devstack sudo[97715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9e632463-8d19-4d7f-bc5b-ed5080ad6267 2147483648 Jul 10 18:17:11 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:11 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3_5sutn94kdevstack@QuobyteHD" returned: 0 in 0.932s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:11 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3 was qcow2, converting to raw {{(pid=87399) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 18:17:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3_5sutn94kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:11 devstack sudo[97720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3_5sutn94kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6 Jul 10 18:17:11 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:12 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9e632463-8d19-4d7f-bc5b-ed5080ad6267 2147483648" returned: 0 in 1.054s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9e632463-8d19-4d7f-bc5b-ed5080ad6267 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:12 devstack sudo[97734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9e632463-8d19-4d7f-bc5b-ed5080ad6267 Jul 10 18:17:12 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:13 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9e632463-8d19-4d7f-bc5b-ed5080ad6267" returned: 0 in 0.771s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:13 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] <== create_volume: return (1872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:17:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:17:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e77d196-c443-416b-aabf-3f88b7c831f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e632463-8d19-4d7f-bc5b-ed5080ad6267', 'volume_size': 2}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f4de95-fb32-4ad2-94f1-9539aaa0ceeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:13 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] Volume volume-9e632463-8d19-4d7f-bc5b-ed5080ad6267 (9e632463-8d19-4d7f-bc5b-ed5080ad6267): created successfully Jul 10 18:17:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63f4de95-fb32-4ad2-94f1-9539aaa0ceeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] Flow 'volume_create_manager' (b24ac05c-65ff-4aaa-a840-a9f670305577) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:17:13 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-b6ba9453-d076-47d7-8170-6b36f6f00a89 tempest-VolumesCloneNegativeTest-675491736 None] Created volume successfully. Jul 10 18:17:13 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3_5sutn94kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6" returned: 0 in 2.063s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:13 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3_5sutn94kdevstack@QuobyteHD, size 112.00 MB, duration 2.06 sec, destination /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6 {{(pid=87399) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 18:17:13 devstack cinder-volume[87399]: INFO cinder.image.image_utils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Converted 112.00 MB image at 54.27 MB/s Jul 10 18:17:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:13 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6 1G Jul 10 18:17:13 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:14 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6 1G" returned: 0 in 0.695s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:14 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f5eca5-0f06-442e-bd88-555f239a1676]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:17:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:14 devstack sudo[97743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6 Jul 10 18:17:14 devstack sudo[97743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:14 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7e9561f3-566a-4bc2-b948-5409cdef1e15 tempest-VolumesCloneNegativeTest-675491736 None] Acquiring lock "cinder-9e632463-8d19-4d7f-bc5b-ed5080ad6267-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:17:14 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7e9561f3-566a-4bc2-b948-5409cdef1e15 tempest-VolumesCloneNegativeTest-675491736 None] Lock "cinder-9e632463-8d19-4d7f-bc5b-ed5080ad6267-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:17:14 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7e9561f3-566a-4bc2-b948-5409cdef1e15 tempest-VolumesCloneNegativeTest-675491736 None] Acquiring lock "cinder-quobyte-9e632463-8d19-4d7f-bc5b-ed5080ad6267" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:17:14 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7e9561f3-566a-4bc2-b948-5409cdef1e15 tempest-VolumesCloneNegativeTest-675491736 None] Lock "cinder-quobyte-9e632463-8d19-4d7f-bc5b-ed5080ad6267" acquired by "delete_volume" :: waited 0.014s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:17:14 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7b1f7a-e31e-46d1-a436-1e20bc5f85e8]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:17:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7e9561f3-566a-4bc2-b948-5409cdef1e15 tempest-VolumesCloneNegativeTest-675491736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9e632463-8d19-4d7f-bc5b-ed5080ad6267 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:14 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9e632463-8d19-4d7f-bc5b-ed5080ad6267 Jul 10 18:17:14 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:15 devstack sudo[97743]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6" returned: 0 in 0.792s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:15 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6 Jul 10 18:17:15 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:15 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7e9561f3-566a-4bc2-b948-5409cdef1e15 tempest-VolumesCloneNegativeTest-675491736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9e632463-8d19-4d7f-bc5b-ed5080ad6267" returned: 0 in 0.863s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7e9561f3-566a-4bc2-b948-5409cdef1e15 tempest-VolumesCloneNegativeTest-675491736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9e632463-8d19-4d7f-bc5b-ed5080ad6267 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:15 devstack sudo[97757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9e632463-8d19-4d7f-bc5b-ed5080ad6267 Jul 10 18:17:15 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:16 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6" returned: 1 in 0.857s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:17:16 devstack cinder-volume[87399]: DEBUG cinder.volume.volume_utils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Downloaded image f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3 ((None, [{'url': 'file:///opt/stack/data/glance/images/f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3', 'metadata': {}}])) to volume 73335b52-40f0-4728-b820-e7250c8323d6 successfully. {{(pid=87399) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 18:17:16 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Temporary image f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3 for user 5f466aa26fa142f39faf442edd7b7e46 is deleted. {{(pid=87399) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 18:17:16 devstack cinder-volume[87399]: DEBUG cinder.volume.volume_utils [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Marking volume 73335b52-40f0-4728-b820-e7250c8323d6 as bootable. {{(pid=87399) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 18:17:16 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Copying metadata from image f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3 to 73335b52-40f0-4728-b820-e7250c8323d6. {{(pid=87399) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 18:17:16 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Creating volume glance metadata for volume 73335b52-40f0-4728-b820-e7250c8323d6 backed by image f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3 with: {'image_id': 'f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3', 'image_name': 'tempest-scenario-img--835927608', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87399) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 18:17:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2dc87d1c-65f4-4c8d-a097-a31780c5840c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73335b52-40f0-4728-b820-e7250c8323d6', 'volume_size': 1, 'image_id': 'f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--835927608', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e32b386a157441d98715617717964267', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3', 'created_at': datetime.datetime(2026, 7, 10, 16, 16, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 16, 16, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f9ffc4bf-a1c9-4844-99fc-d3fcb07ff7b3/file', 'properties': {}}, 'image_service': }' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f64766b-62ee-406e-bde6-6bc248431eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:16 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Volume volume-73335b52-40f0-4728-b820-e7250c8323d6 (73335b52-40f0-4728-b820-e7250c8323d6): created successfully Jul 10 18:17:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f64766b-62ee-406e-bde6-6bc248431eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Flow 'volume_create_manager' (3b0ec4fe-14dc-4fa6-bd14-b3169963c172) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:17:16 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-c8024176-b4a5-447c-b9f8-86f76b1b5c0a tempest-TestInstancesWithCinderVolumes-348398060 None] Created volume successfully. Jul 10 18:17:16 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7e9561f3-566a-4bc2-b948-5409cdef1e15 tempest-VolumesCloneNegativeTest-675491736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9e632463-8d19-4d7f-bc5b-ed5080ad6267" returned: 0 in 0.703s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:16 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7e9561f3-566a-4bc2-b948-5409cdef1e15 tempest-VolumesCloneNegativeTest-675491736 None] Lock "cinder-quobyte-9e632463-8d19-4d7f-bc5b-ed5080ad6267" released by "delete_volume" :: held 1.604s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:17:16 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-7e9561f3-566a-4bc2-b948-5409cdef1e15 tempest-VolumesCloneNegativeTest-675491736 None] Created reservations ['87d7e7be-af7c-4044-84c2-805dc931847e', '4b2be050-2927-4266-815c-7545dcecb403', '79c5c008-5972-4321-8f45-669a859cf9ac', 'bf33817e-2968-4411-b3bb-250cf49ef2e5'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:17:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7e9561f3-566a-4bc2-b948-5409cdef1e15 tempest-VolumesCloneNegativeTest-675491736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:17:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7e9561f3-566a-4bc2-b948-5409cdef1e15 tempest-VolumesCloneNegativeTest-675491736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:17:16 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7e9561f3-566a-4bc2-b948-5409cdef1e15 tempest-VolumesCloneNegativeTest-675491736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:17:16 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7e9561f3-566a-4bc2-b948-5409cdef1e15 tempest-VolumesCloneNegativeTest-675491736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:17:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7e9561f3-566a-4bc2-b948-5409cdef1e15 tempest-VolumesCloneNegativeTest-675491736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:17:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7e9561f3-566a-4bc2-b948-5409cdef1e15 tempest-VolumesCloneNegativeTest-675491736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:16 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:17:16 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:17 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7e9561f3-566a-4bc2-b948-5409cdef1e15 tempest-VolumesCloneNegativeTest-675491736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.879s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:17 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-7e9561f3-566a-4bc2-b948-5409cdef1e15 tempest-VolumesCloneNegativeTest-675491736 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:17:17 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-7e9561f3-566a-4bc2-b948-5409cdef1e15 tempest-VolumesCloneNegativeTest-675491736 None] Deleted volume successfully. Jul 10 18:17:17 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7e9561f3-566a-4bc2-b948-5409cdef1e15 tempest-VolumesCloneNegativeTest-675491736 None] Lock "cinder-9e632463-8d19-4d7f-bc5b-ed5080ad6267-delete_volume" released by "delete_volume" :: held 2.678s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:17:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-7c76844e-6e9f-4df3-ba5b-e88e31e8cd26 req-2bde1095-03f0-49d9-8789-a00bcdb968aa tempest-TestServerVolumeAttachmentScenario-1008122108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:17:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-7c76844e-6e9f-4df3-ba5b-e88e31e8cd26 req-2bde1095-03f0-49d9-8789-a00bcdb968aa tempest-TestServerVolumeAttachmentScenario-1008122108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:17:19 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d4c4e1-1123-49b8-a013-d13bce10d3c8]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:17:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-7c76844e-6e9f-4df3-ba5b-e88e31e8cd26 req-2bde1095-03f0-49d9-8789-a00bcdb968aa tempest-TestServerVolumeAttachmentScenario-1008122108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-676b02f2-1508-4ae1-97a2-ba6ed5191b0d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:19 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-676b02f2-1508-4ae1-97a2-ba6ed5191b0d Jul 10 18:17:19 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:20 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-7c76844e-6e9f-4df3-ba5b-e88e31e8cd26 req-2bde1095-03f0-49d9-8789-a00bcdb968aa tempest-TestServerVolumeAttachmentScenario-1008122108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-676b02f2-1508-4ae1-97a2-ba6ed5191b0d" returned: 0 in 0.991s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-7c76844e-6e9f-4df3-ba5b-e88e31e8cd26 req-2bde1095-03f0-49d9-8789-a00bcdb968aa tempest-TestServerVolumeAttachmentScenario-1008122108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.030s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:17:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-7c76844e-6e9f-4df3-ba5b-e88e31e8cd26 req-2bde1095-03f0-49d9-8789-a00bcdb968aa tempest-TestServerVolumeAttachmentScenario-1008122108 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd', 'name': 'volume-676b02f2-1508-4ae1-97a2-ba6ed5191b0d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6bb4dabb-cc2d-4606-9217-cc83867f16d0', 'enforce_multipath': True} {{(pid=87399) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 18:17:20 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-7c76844e-6e9f-4df3-ba5b-e88e31e8cd26 req-2bde1095-03f0-49d9-8789-a00bcdb968aa tempest-TestServerVolumeAttachmentScenario-1008122108 None] attachment_update completed successfully. Jul 10 18:17:20 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:17:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] Flow 'volume_create_manager' (836e0fda-d124-4cc1-a3a4-554bfa2fac2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:17:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c746abb-8107-4661-abb9-f49ce8b20a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c746abb-8107-4661-abb9-f49ce8b20a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-73006300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b8c6d5b-64f4-4e01-8a9e-fd2312b0a1f0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4898665ebdb74705bdae670aa3407916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:17:21Z,use_quota=True,user_id='a7408409b60b40298e22b3506cbdf7a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d935df-0013-46fa-b3fe-af0a331f94f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d935df-0013-46fa-b3fe-af0a331f94f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47940d33-a9a2-42b2-b81d-bbd489cf1527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47940d33-a9a2-42b2-b81d-bbd489cf1527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b8c6d5b-64f4-4e01-8a9e-fd2312b0a1f0', 'volume_name': 'volume-1b8c6d5b-64f4-4e01-8a9e-fd2312b0a1f0', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b24417c0-eacf-455e-a47b-c2ea33ee1b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b24417c0-eacf-455e-a47b-c2ea33ee1b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8381d0f5-2e2a-48a4-a9e9-50b11f518708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:20 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] Volume 1b8c6d5b-64f4-4e01-8a9e-fd2312b0a1f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b8c6d5b-64f4-4e01-8a9e-fd2312b0a1f0', 'volume_size': 1} Jul 10 18:17:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:17:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:17:20 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:17:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-73006300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b8c6d5b-64f4-4e01-8a9e-fd2312b0a1f0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4898665ebdb74705bdae670aa3407916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:17:21Z,use_quota=True,user_id='a7408409b60b40298e22b3506cbdf7a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:17:20 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] Creating volume 1b8c6d5b-64f4-4e01-8a9e-fd2312b0a1f0 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:17:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:17:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:17:20 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:17:20 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:17:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:17:20 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:17:20 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:17:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1b8c6d5b-64f4-4e01-8a9e-fd2312b0a1f0 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:20 devstack sudo[97802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1b8c6d5b-64f4-4e01-8a9e-fd2312b0a1f0 1073741824 Jul 10 18:17:20 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:21 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1b8c6d5b-64f4-4e01-8a9e-fd2312b0a1f0 1073741824" returned: 0 in 1.036s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1b8c6d5b-64f4-4e01-8a9e-fd2312b0a1f0 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:21 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1b8c6d5b-64f4-4e01-8a9e-fd2312b0a1f0 Jul 10 18:17:21 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:22 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1b8c6d5b-64f4-4e01-8a9e-fd2312b0a1f0" returned: 0 in 0.667s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:22 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] <== create_volume: return (1749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:17:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.753s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:17:22 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8381d0f5-2e2a-48a4-a9e9-50b11f518708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b8c6d5b-64f4-4e01-8a9e-fd2312b0a1f0', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:22 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3634c9ce-ff45-4086-9218-4b95fabbe060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:22 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] Volume volume-1b8c6d5b-64f4-4e01-8a9e-fd2312b0a1f0 (1b8c6d5b-64f4-4e01-8a9e-fd2312b0a1f0): created successfully Jul 10 18:17:22 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3634c9ce-ff45-4086-9218-4b95fabbe060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:22 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] Flow 'volume_create_manager' (836e0fda-d124-4cc1-a3a4-554bfa2fac2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:17:22 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-e14502cd-01f7-4478-8561-48c68231e64c tempest-VolumesGetTest-1709091377 None] Created volume successfully. Jul 10 18:17:24 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:17:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] Flow 'volume_create_manager' (2dd75ab2-079d-4b0d-a6ba-53efa0e13927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:17:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (495e3548-f217-4fe9-9c38-98c552f024fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (495e3548-f217-4fe9-9c38-98c552f024fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:17:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2033068860',display_name='tempest-VolumesGetTest-Volume-1932662413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b9ee21-0c25-4c66-ad7e-e02005b0205a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4898665ebdb74705bdae670aa3407916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:17:24Z,use_quota=True,user_id='a7408409b60b40298e22b3506cbdf7a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e3e122-2f25-42b2-9b72-083bbde8fbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e3e122-2f25-42b2-9b72-083bbde8fbc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6197b68b-59ed-4856-916d-324ea65b619e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6197b68b-59ed-4856-916d-324ea65b619e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43b9ee21-0c25-4c66-ad7e-e02005b0205a', 'volume_name': 'volume-43b9ee21-0c25-4c66-ad7e-e02005b0205a', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99aca74e-c65f-42ac-92d4-0e709461149e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99aca74e-c65f-42ac-92d4-0e709461149e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a6275f-6a5b-40c1-be94-25b608eb1c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:24 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] Volume 43b9ee21-0c25-4c66-ad7e-e02005b0205a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43b9ee21-0c25-4c66-ad7e-e02005b0205a', 'volume_size': 1} Jul 10 18:17:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:17:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:17:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:17:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2033068860',display_name='tempest-VolumesGetTest-Volume-1932662413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b9ee21-0c25-4c66-ad7e-e02005b0205a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4898665ebdb74705bdae670aa3407916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:17:24Z,use_quota=True,user_id='a7408409b60b40298e22b3506cbdf7a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:17:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] Creating volume 43b9ee21-0c25-4c66-ad7e-e02005b0205a {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:17:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:17:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:17:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:17:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:17:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:17:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:17:24 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:17:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-43b9ee21-0c25-4c66-ad7e-e02005b0205a 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:24 devstack sudo[98240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-43b9ee21-0c25-4c66-ad7e-e02005b0205a 1073741824 Jul 10 18:17:24 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-696ff648-a61f-4251-977f-5cde9cf53f98 req-bc9f4833-d0a6-42c4-a963-be97c316fa07 tempest-TestInstancesWithCinderVolumes-348398060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:17:25 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-43b9ee21-0c25-4c66-ad7e-e02005b0205a 1073741824" returned: 0 in 1.335s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-43b9ee21-0c25-4c66-ad7e-e02005b0205a {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:25 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-43b9ee21-0c25-4c66-ad7e-e02005b0205a Jul 10 18:17:25 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:26 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-43b9ee21-0c25-4c66-ad7e-e02005b0205a" returned: 0 in 1.016s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:26 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] <== create_volume: return (2418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:17:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.421s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:17:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-696ff648-a61f-4251-977f-5cde9cf53f98 req-bc9f4833-d0a6-42c4-a963-be97c316fa07 tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.392s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:17:26 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a6275f-6a5b-40c1-be94-25b608eb1c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43b9ee21-0c25-4c66-ad7e-e02005b0205a', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:26 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbde96d1-0620-41f3-81b4-b8aceb0c3573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:26 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] Volume volume-43b9ee21-0c25-4c66-ad7e-e02005b0205a (43b9ee21-0c25-4c66-ad7e-e02005b0205a): created successfully Jul 10 18:17:26 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbde96d1-0620-41f3-81b4-b8aceb0c3573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:26 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] Flow 'volume_create_manager' (2dd75ab2-079d-4b0d-a6ba-53efa0e13927) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:17:26 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a52a11-72f3-41da-9a96-1b1422d6b5cb]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:17:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-696ff648-a61f-4251-977f-5cde9cf53f98 req-bc9f4833-d0a6-42c4-a963-be97c316fa07 tempest-TestInstancesWithCinderVolumes-348398060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:26 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-d4544f80-45eb-4ee5-821b-ad983162adc1 tempest-VolumesGetTest-1709091377 None] Created volume successfully. Jul 10 18:17:26 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6 Jul 10 18:17:26 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:27 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-696ff648-a61f-4251-977f-5cde9cf53f98 req-bc9f4833-d0a6-42c4-a963-be97c316fa07 tempest-TestInstancesWithCinderVolumes-348398060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6" returned: 0 in 1.286s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-696ff648-a61f-4251-977f-5cde9cf53f98 req-bc9f4833-d0a6-42c4-a963-be97c316fa07 tempest-TestInstancesWithCinderVolumes-348398060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:28 devstack sudo[98301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6 Jul 10 18:17:28 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:28 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3f2a2bb7-20a2-4bfb-98ab-354ff9ea4417 tempest-VolumesGetTest-1709091377 None] Acquiring lock "cinder-43b9ee21-0c25-4c66-ad7e-e02005b0205a-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:17:28 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3f2a2bb7-20a2-4bfb-98ab-354ff9ea4417 tempest-VolumesGetTest-1709091377 None] Lock "cinder-43b9ee21-0c25-4c66-ad7e-e02005b0205a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:17:28 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3f2a2bb7-20a2-4bfb-98ab-354ff9ea4417 tempest-VolumesGetTest-1709091377 None] Acquiring lock "cinder-quobyte-43b9ee21-0c25-4c66-ad7e-e02005b0205a" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:17:28 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3f2a2bb7-20a2-4bfb-98ab-354ff9ea4417 tempest-VolumesGetTest-1709091377 None] Lock "cinder-quobyte-43b9ee21-0c25-4c66-ad7e-e02005b0205a" acquired by "delete_volume" :: waited 0.058s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:17:28 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc754a37-af14-43ff-b307-41a9cb9155ee]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:17:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3f2a2bb7-20a2-4bfb-98ab-354ff9ea4417 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-43b9ee21-0c25-4c66-ad7e-e02005b0205a {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:28 devstack sudo[98303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-43b9ee21-0c25-4c66-ad7e-e02005b0205a Jul 10 18:17:28 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:29 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-696ff648-a61f-4251-977f-5cde9cf53f98 req-bc9f4833-d0a6-42c4-a963-be97c316fa07 tempest-TestInstancesWithCinderVolumes-348398060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6" returned: 1 in 1.223s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-696ff648-a61f-4251-977f-5cde9cf53f98 req-bc9f4833-d0a6-42c4-a963-be97c316fa07 tempest-TestInstancesWithCinderVolumes-348398060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:17:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-696ff648-a61f-4251-977f-5cde9cf53f98 req-bc9f4833-d0a6-42c4-a963-be97c316fa07 tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.589s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:17:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-696ff648-a61f-4251-977f-5cde9cf53f98 req-bc9f4833-d0a6-42c4-a963-be97c316fa07 tempest-TestInstancesWithCinderVolumes-348398060 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd', 'name': 'volume-73335b52-40f0-4728-b820-e7250c8323d6', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3770bfc5-2c5e-43fa-9485-3ee173c5bc72', 'enforce_multipath': True} {{(pid=87399) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 18:17:29 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-696ff648-a61f-4251-977f-5cde9cf53f98 req-bc9f4833-d0a6-42c4-a963-be97c316fa07 tempest-TestInstancesWithCinderVolumes-348398060 None] attachment_update completed successfully. Jul 10 18:17:29 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3f2a2bb7-20a2-4bfb-98ab-354ff9ea4417 tempest-VolumesGetTest-1709091377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-43b9ee21-0c25-4c66-ad7e-e02005b0205a" returned: 0 in 1.116s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3f2a2bb7-20a2-4bfb-98ab-354ff9ea4417 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-43b9ee21-0c25-4c66-ad7e-e02005b0205a {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:29 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-43b9ee21-0c25-4c66-ad7e-e02005b0205a Jul 10 18:17:29 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:30 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3f2a2bb7-20a2-4bfb-98ab-354ff9ea4417 tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-43b9ee21-0c25-4c66-ad7e-e02005b0205a" returned: 0 in 0.828s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:30 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3f2a2bb7-20a2-4bfb-98ab-354ff9ea4417 tempest-VolumesGetTest-1709091377 None] Lock "cinder-quobyte-43b9ee21-0c25-4c66-ad7e-e02005b0205a" released by "delete_volume" :: held 2.028s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:17:30 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-3f2a2bb7-20a2-4bfb-98ab-354ff9ea4417 tempest-VolumesGetTest-1709091377 None] Created reservations ['c864b0c6-d21f-48dd-9ab1-4102c1358f0e', '33bced2c-65ff-474a-ba29-2f0eef9a8466', '65347d97-6231-461b-8085-8f54ecb240e5', 'ab44187a-516a-489f-8103-fe280bb3758e'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:17:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3f2a2bb7-20a2-4bfb-98ab-354ff9ea4417 tempest-VolumesGetTest-1709091377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:17:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3f2a2bb7-20a2-4bfb-98ab-354ff9ea4417 tempest-VolumesGetTest-1709091377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:17:30 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-3f2a2bb7-20a2-4bfb-98ab-354ff9ea4417 tempest-VolumesGetTest-1709091377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:17:30 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-3f2a2bb7-20a2-4bfb-98ab-354ff9ea4417 tempest-VolumesGetTest-1709091377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:17:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3f2a2bb7-20a2-4bfb-98ab-354ff9ea4417 tempest-VolumesGetTest-1709091377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:17:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3f2a2bb7-20a2-4bfb-98ab-354ff9ea4417 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:30 devstack sudo[98319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:17:30 devstack sudo[98319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:31 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d14ef3aa-e746-45b0-bc98-bbaa3a3d4d47 tempest-VolumesGetTest-1709091377 None] Acquiring lock "cinder-1b8c6d5b-64f4-4e01-8a9e-fd2312b0a1f0-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:17:31 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d14ef3aa-e746-45b0-bc98-bbaa3a3d4d47 tempest-VolumesGetTest-1709091377 None] Lock "cinder-1b8c6d5b-64f4-4e01-8a9e-fd2312b0a1f0-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:17:31 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d14ef3aa-e746-45b0-bc98-bbaa3a3d4d47 tempest-VolumesGetTest-1709091377 None] Acquiring lock "cinder-quobyte-1b8c6d5b-64f4-4e01-8a9e-fd2312b0a1f0" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:17:31 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d14ef3aa-e746-45b0-bc98-bbaa3a3d4d47 tempest-VolumesGetTest-1709091377 None] Lock "cinder-quobyte-1b8c6d5b-64f4-4e01-8a9e-fd2312b0a1f0" acquired by "delete_volume" :: waited 0.025s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:17:31 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[425328ee-3e46-46c3-b5dc-6a9c10673d6e]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:17:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d14ef3aa-e746-45b0-bc98-bbaa3a3d4d47 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1b8c6d5b-64f4-4e01-8a9e-fd2312b0a1f0 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:31 devstack sudo[98321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1b8c6d5b-64f4-4e01-8a9e-fd2312b0a1f0 Jul 10 18:17:31 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:31 devstack sudo[98319]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3f2a2bb7-20a2-4bfb-98ab-354ff9ea4417 tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.055s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:31 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-3f2a2bb7-20a2-4bfb-98ab-354ff9ea4417 tempest-VolumesGetTest-1709091377 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:17:31 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-3f2a2bb7-20a2-4bfb-98ab-354ff9ea4417 tempest-VolumesGetTest-1709091377 None] Deleted volume successfully. Jul 10 18:17:31 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3f2a2bb7-20a2-4bfb-98ab-354ff9ea4417 tempest-VolumesGetTest-1709091377 None] Lock "cinder-43b9ee21-0c25-4c66-ad7e-e02005b0205a-delete_volume" released by "delete_volume" :: held 3.396s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:17:32 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d14ef3aa-e746-45b0-bc98-bbaa3a3d4d47 tempest-VolumesGetTest-1709091377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1b8c6d5b-64f4-4e01-8a9e-fd2312b0a1f0" returned: 0 in 1.155s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d14ef3aa-e746-45b0-bc98-bbaa3a3d4d47 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1b8c6d5b-64f4-4e01-8a9e-fd2312b0a1f0 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:32 devstack sudo[98335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1b8c6d5b-64f4-4e01-8a9e-fd2312b0a1f0 Jul 10 18:17:32 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-47e0b6e8-7178-4d8f-af14-216d5713671c req-4b29bb2f-dcec-4faf-9b7f-1cfaf98447ad tempest-TestServerVolumeAttachmentScenario-1008122108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:17:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-47e0b6e8-7178-4d8f-af14-216d5713671c req-4b29bb2f-dcec-4faf-9b7f-1cfaf98447ad tempest-TestServerVolumeAttachmentScenario-1008122108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:17:32 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd85216f-a801-47b0-bdf1-57e1f77983a5]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:17:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-47e0b6e8-7178-4d8f-af14-216d5713671c req-4b29bb2f-dcec-4faf-9b7f-1cfaf98447ad tempest-TestServerVolumeAttachmentScenario-1008122108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-21a002ed-7e38-47f0-b3fd-d6c30607efa4 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:32 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-21a002ed-7e38-47f0-b3fd-d6c30607efa4 Jul 10 18:17:32 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:33 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d14ef3aa-e746-45b0-bc98-bbaa3a3d4d47 tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1b8c6d5b-64f4-4e01-8a9e-fd2312b0a1f0" returned: 0 in 1.178s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:33 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d14ef3aa-e746-45b0-bc98-bbaa3a3d4d47 tempest-VolumesGetTest-1709091377 None] Lock "cinder-quobyte-1b8c6d5b-64f4-4e01-8a9e-fd2312b0a1f0" released by "delete_volume" :: held 2.421s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:17:33 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-d14ef3aa-e746-45b0-bc98-bbaa3a3d4d47 tempest-VolumesGetTest-1709091377 None] Created reservations ['86d9174e-9c65-4aed-a3cf-d5570a61acca', 'ec57516f-2a5f-4f29-b21c-8fa91a55d38e', 'bafae64c-c575-43d9-8a1f-f1f03dfec4ca', '62945e0e-1e28-4e86-b878-9fc82de9307f'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:17:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d14ef3aa-e746-45b0-bc98-bbaa3a3d4d47 tempest-VolumesGetTest-1709091377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:17:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d14ef3aa-e746-45b0-bc98-bbaa3a3d4d47 tempest-VolumesGetTest-1709091377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:17:33 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d14ef3aa-e746-45b0-bc98-bbaa3a3d4d47 tempest-VolumesGetTest-1709091377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:17:33 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d14ef3aa-e746-45b0-bc98-bbaa3a3d4d47 tempest-VolumesGetTest-1709091377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:17:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d14ef3aa-e746-45b0-bc98-bbaa3a3d4d47 tempest-VolumesGetTest-1709091377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:17:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d14ef3aa-e746-45b0-bc98-bbaa3a3d4d47 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:33 devstack sudo[98384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:17:33 devstack sudo[98384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:34 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-47e0b6e8-7178-4d8f-af14-216d5713671c req-4b29bb2f-dcec-4faf-9b7f-1cfaf98447ad tempest-TestServerVolumeAttachmentScenario-1008122108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-21a002ed-7e38-47f0-b3fd-d6c30607efa4" returned: 0 in 1.829s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-47e0b6e8-7178-4d8f-af14-216d5713671c req-4b29bb2f-dcec-4faf-9b7f-1cfaf98447ad tempest-TestServerVolumeAttachmentScenario-1008122108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.846s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:17:34 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-47e0b6e8-7178-4d8f-af14-216d5713671c req-4b29bb2f-dcec-4faf-9b7f-1cfaf98447ad tempest-TestServerVolumeAttachmentScenario-1008122108 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd', 'name': 'volume-21a002ed-7e38-47f0-b3fd-d6c30607efa4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '25e3fa4f-e854-4955-8059-4db46f065c53', 'enforce_multipath': True} {{(pid=87399) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 18:17:34 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-47e0b6e8-7178-4d8f-af14-216d5713671c req-4b29bb2f-dcec-4faf-9b7f-1cfaf98447ad tempest-TestServerVolumeAttachmentScenario-1008122108 None] attachment_update completed successfully. Jul 10 18:17:35 devstack sudo[98384]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d14ef3aa-e746-45b0-bc98-bbaa3a3d4d47 tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.190s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:35 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-d14ef3aa-e746-45b0-bc98-bbaa3a3d4d47 tempest-VolumesGetTest-1709091377 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:17:35 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-d14ef3aa-e746-45b0-bc98-bbaa3a3d4d47 tempest-VolumesGetTest-1709091377 None] Deleted volume successfully. Jul 10 18:17:35 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d14ef3aa-e746-45b0-bc98-bbaa3a3d4d47 tempest-VolumesGetTest-1709091377 None] Lock "cinder-1b8c6d5b-64f4-4e01-8a9e-fd2312b0a1f0-delete_volume" released by "delete_volume" :: held 3.998s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:17:35 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:17:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] Flow 'volume_create_manager' (63d458d9-e603-492c-ad39-97bf83eb61ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:17:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48df1e89-5faa-4dd7-a333-8bbd5b760294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48df1e89-5faa-4dd7-a333-8bbd5b760294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-463007715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9d0260b-7d8e-441e-be6e-4c537d366560,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4898665ebdb74705bdae670aa3407916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:17:35Z,use_quota=True,user_id='a7408409b60b40298e22b3506cbdf7a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f72a01aa-56e9-44bc-bb24-a57990f6fb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f72a01aa-56e9-44bc-bb24-a57990f6fb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (386eb4fd-31b1-400b-9041-898fb8e370cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (386eb4fd-31b1-400b-9041-898fb8e370cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9d0260b-7d8e-441e-be6e-4c537d366560', 'volume_name': 'volume-c9d0260b-7d8e-441e-be6e-4c537d366560', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c1c678-5f2b-4b15-9d6a-4c35280740b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c1c678-5f2b-4b15-9d6a-4c35280740b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a64189-01f1-420f-9df9-9d55e35c154a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:35 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] Volume c9d0260b-7d8e-441e-be6e-4c537d366560: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9d0260b-7d8e-441e-be6e-4c537d366560', 'volume_size': 1} Jul 10 18:17:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:17:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:17:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-463007715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9d0260b-7d8e-441e-be6e-4c537d366560,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4898665ebdb74705bdae670aa3407916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:17:35Z,use_quota=True,user_id='a7408409b60b40298e22b3506cbdf7a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:17:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] Creating volume c9d0260b-7d8e-441e-be6e-4c537d366560 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:17:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:17:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:17:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:17:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:17:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:17:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:17:35 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:17:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:35 devstack sudo[98414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560 1073741824 Jul 10 18:17:35 devstack sudo[98414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:36 devstack sudo[98414]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560 1073741824" returned: 0 in 1.043s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:36 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560 Jul 10 18:17:36 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:37 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560" returned: 0 in 0.867s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:37 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] <== create_volume: return (1965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:17:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.968s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:17:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01a64189-01f1-420f-9df9-9d55e35c154a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9d0260b-7d8e-441e-be6e-4c537d366560', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43442d7c-b6c7-48fd-96d0-cef155b8c298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:37 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] Volume volume-c9d0260b-7d8e-441e-be6e-4c537d366560 (c9d0260b-7d8e-441e-be6e-4c537d366560): created successfully Jul 10 18:17:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43442d7c-b6c7-48fd-96d0-cef155b8c298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] Flow 'volume_create_manager' (63d458d9-e603-492c-ad39-97bf83eb61ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:17:37 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-f5384fc8-3888-490e-9c00-e7d23bf3e0b0 tempest-VolumesGetTest-1709091377 None] Created volume successfully. Jul 10 18:17:39 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:17:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Flow 'volume_create_manager' (533dce8a-815b-4e6c-9116-d56244c971c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:17:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c57821f7-e827-4a3f-9346-a9a57930060a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c57821f7-e827-4a3f-9346-a9a57930060a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1687405094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03f07bac-ee51-45b6-bb65-87e82d16953f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4898665ebdb74705bdae670aa3407916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=c9d0260b-7d8e-441e-be6e-4c537d366560,status='creating',terminated_at=None,updated_at=2026-07-10T16:17:39Z,use_quota=True,user_id='a7408409b60b40298e22b3506cbdf7a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc9cf5c-e3b2-45bc-b1ca-8a6d2397d3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc9cf5c-e3b2-45bc-b1ca-8a6d2397d3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c6a2203-5141-4ab6-b149-63a6844c6cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c6a2203-5141-4ab6-b149-63a6844c6cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '03f07bac-ee51-45b6-bb65-87e82d16953f', 'volume_name': 'volume-03f07bac-ee51-45b6-bb65-87e82d16953f', 'volume_size': 1, 'source_volid': 'c9d0260b-7d8e-441e-be6e-4c537d366560', 'source_volstatus': 'available'}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af22201b-fabf-4a63-9f83-7cacacc2b869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af22201b-fabf-4a63-9f83-7cacacc2b869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9490e24-00cf-4688-990a-e269a558458c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:39 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Volume 03f07bac-ee51-45b6-bb65-87e82d16953f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-03f07bac-ee51-45b6-bb65-87e82d16953f', 'volume_size': 1, 'source_volid': 'c9d0260b-7d8e-441e-be6e-4c537d366560', 'source_volstatus': 'available'} Jul 10 18:17:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:17:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:17:39 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Cloning volume c9d0260b-7d8e-441e-be6e-4c537d366560 to volume 03f07bac-ee51-45b6-bb65-87e82d16953f Jul 10 18:17:39 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Creating offline snapshot 94f1eda1-788b-4007-b98f-22041e71d933 of volume c9d0260b-7d8e-441e-be6e-4c537d366560 {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:17:39 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f1c059-9752-49e3-b281-aa6ee0e548ed]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:17:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:39 devstack sudo[98451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560 Jul 10 18:17:39 devstack sudo[98451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:40 devstack sudo[98451]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560" returned: 0 in 1.079s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560.94f1eda1-788b-4007-b98f-22041e71d933 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:40 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560.94f1eda1-788b-4007-b98f-22041e71d933 1G Jul 10 18:17:40 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:41 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-2faa0a65-c79c-400d-87d6-78f7257b5d8b req-c94908ce-6131-4d78-8114-0cc60164914e tempest-TestServerVolumeAttachmentScenario-1008122108 None] Terminate volume connection completed successfully. Jul 10 18:17:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-2faa0a65-c79c-400d-87d6-78f7257b5d8b req-c94908ce-6131-4d78-8114-0cc60164914e tempest-TestServerVolumeAttachmentScenario-1008122108 None] Deleting attachment 25e3fa4f-e854-4955-8059-4db46f065c53. {{(pid=87399) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 18:17:42 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560.94f1eda1-788b-4007-b98f-22041e71d933 1G" returned: 0 in 1.283s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9d0260b-7d8e-441e-be6e-4c537d366560 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560.94f1eda1-788b-4007-b98f-22041e71d933 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:42 devstack sudo[98491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9d0260b-7d8e-441e-be6e-4c537d366560 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560.94f1eda1-788b-4007-b98f-22041e71d933 Jul 10 18:17:42 devstack sudo[98491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:42 devstack sudo[98491]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9d0260b-7d8e-441e-be6e-4c537d366560 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560.94f1eda1-788b-4007-b98f-22041e71d933" returned: 0 in 0.871s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:42 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560.94f1eda1-788b-4007-b98f-22041e71d933 is being set with open permissions: ugo+rw Jul 10 18:17:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560.94f1eda1-788b-4007-b98f-22041e71d933 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:43 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560.94f1eda1-788b-4007-b98f-22041e71d933 Jul 10 18:17:43 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:43 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560.94f1eda1-788b-4007-b98f-22041e71d933" returned: 0 in 0.809s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:43 devstack sudo[98500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560.info Jul 10 18:17:43 devstack sudo[98500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:44 devstack sudo[98500]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560.info" returned: 0 in 0.776s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:44 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560.info is being set with open permissions: ugo+rw Jul 10 18:17:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:44 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560.info Jul 10 18:17:44 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:45 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-39a36438-49f7-45c9-af6d-7437c3457160 req-f256db09-d5fd-4d75-93ef-f40bcf7b33ee tempest-TestServerVolumeAttachmentScenario-1008122108 None] Terminate volume connection completed successfully. Jul 10 18:17:45 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-39a36438-49f7-45c9-af6d-7437c3457160 req-f256db09-d5fd-4d75-93ef-f40bcf7b33ee tempest-TestServerVolumeAttachmentScenario-1008122108 None] Deleting attachment 6bb4dabb-cc2d-4606-9217-cc83867f16d0. {{(pid=87399) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 18:17:45 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560.info" returned: 0 in 1.244s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:45 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Acquiring lock "cinder-quobyte-03f07bac-ee51-45b6-bb65-87e82d16953f" by "_copy_volume_from_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:17:45 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Lock "cinder-quobyte-03f07bac-ee51-45b6-bb65-87e82d16953f" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:17:45 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] snapshot: 94f1eda1-788b-4007-b98f-22041e71d933, volume: 03f07bac-ee51-45b6-bb65-87e82d16953f, {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 18:17:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:17:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:17:45 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:17:45 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:17:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:17:45 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3d562a-a1fc-4124-b17f-80d50ce0decd]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:17:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560.94f1eda1-788b-4007-b98f-22041e71d933 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:46 devstack sudo[98547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560.94f1eda1-788b-4007-b98f-22041e71d933 Jul 10 18:17:46 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:46 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560.94f1eda1-788b-4007-b98f-22041e71d933" returned: 0 in 0.757s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:46 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9d0260b-7d8e-441e-be6e-4c537d366560(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:17:46 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] will copy from snapshot at /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560 {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 18:17:46 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Creating direct copy from snapshot {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 18:17:46 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ac20b4-4167-4acc-9ad7-047570279bfe]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:17:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:46 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560 Jul 10 18:17:46 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:47 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560" returned: 0 in 0.993s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:47 devstack cinder-volume[87399]: DEBUG cinder.utils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Path /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-03f07bac-ee51-45b6-bb65-87e82d16953f not found in is_blk_device check {{(pid=87399) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 18:17:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-03f07bac-ee51-45b6-bb65-87e82d16953f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:47 devstack sudo[98558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-03f07bac-ee51-45b6-bb65-87e82d16953f Jul 10 18:17:47 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:52 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=68,cinder:INSERT=20,cinder:UPDATE=71,cinder:DELETE=5 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:17:52 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=71,cinder:INSERT=19,cinder:UPDATE=72,cinder:DELETE=8 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:17:52 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:17:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] Flow 'volume_create_manager' (de37da3a-17cd-4fc1-b129-edf0a2a7a631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:17:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb30b6e-dc7e-41f8-981e-8cb9422f6aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fb30b6e-dc7e-41f8-981e-8cb9422f6aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-568221925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db4a6fda-eab1-414d-bcbc-14cead251f34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5959ef76a8de4f2cb8e7113819129a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:17:53Z,use_quota=True,user_id='e9b01c20bfba460389c5557d523f4867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b611e62-38eb-40d7-bb97-877b61cdbc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b611e62-38eb-40d7-bb97-877b61cdbc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd15cf1-36c4-4863-a4c6-15ac800e014a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd15cf1-36c4-4863-a4c6-15ac800e014a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db4a6fda-eab1-414d-bcbc-14cead251f34', 'volume_name': 'volume-db4a6fda-eab1-414d-bcbc-14cead251f34', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc61c52c-708a-45d4-b8a4-cb0f35b079f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc61c52c-708a-45d4-b8a4-cb0f35b079f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:17:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c0f6efd-5667-4221-b9b4-0d643b0314ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:17:52 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] Volume db4a6fda-eab1-414d-bcbc-14cead251f34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db4a6fda-eab1-414d-bcbc-14cead251f34', 'volume_size': 1} Jul 10 18:17:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:17:55 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-03f07bac-ee51-45b6-bb65-87e82d16953f" returned: 0 in 7.455s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:55 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ef8a53-0032-4bfd-a304-3319f2c182db]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:17:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:55 devstack sudo[98687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560 Jul 10 18:17:55 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:56 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560" returned: 0 in 0.974s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:56 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Image conversion details: src /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560, size 1024.00 MB, duration 7.46 sec, destination /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-03f07bac-ee51-45b6-bb65-87e82d16953f {{(pid=87399) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 18:17:56 devstack cinder-volume[87399]: INFO cinder.image.image_utils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Converted 1024.00 MB image at 137.35 MB/s Jul 10 18:17:56 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-03f07bac-ee51-45b6-bb65-87e82d16953f is being set with open permissions: ugo+rw Jul 10 18:17:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-03f07bac-ee51-45b6-bb65-87e82d16953f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:56 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-03f07bac-ee51-45b6-bb65-87e82d16953f Jul 10 18:17:56 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:56 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-03f07bac-ee51-45b6-bb65-87e82d16953f" returned: 0 in 0.648s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:56 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Lock "cinder-quobyte-03f07bac-ee51-45b6-bb65-87e82d16953f" released by "_copy_volume_from_snapshot" :: held 10.914s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:17:56 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Acquiring lock "cinder-quobyte-94f1eda1-788b-4007-b98f-22041e71d933" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:17:56 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Lock "cinder-quobyte-94f1eda1-788b-4007-b98f-22041e71d933" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:17:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Deleting offline snapshot 94f1eda1-788b-4007-b98f-22041e71d933 of volume c9d0260b-7d8e-441e-be6e-4c537d366560 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:17:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] snapshot_file for this snap is: volume-c9d0260b-7d8e-441e-be6e-4c537d366560.94f1eda1-788b-4007-b98f-22041e71d933 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:17:56 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afff222-95b1-41c6-b6c7-3ea089b92bfb]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:17:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560.94f1eda1-788b-4007-b98f-22041e71d933 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:57 devstack sudo[98696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560.94f1eda1-788b-4007-b98f-22041e71d933 Jul 10 18:17:57 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:57 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:17:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:17:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:17:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:17:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:17:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:17:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:57 devstack sudo[98700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:17:57 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:57 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560.94f1eda1-788b-4007-b98f-22041e71d933" returned: 0 in 0.750s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9d0260b-7d8e-441e-be6e-4c537d366560(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:17:57 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[546ae1c8-8ecc-46e0-9193-4fd089b44faa]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:17:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:57 devstack sudo[98704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560 Jul 10 18:17:57 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:58 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.699s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:58 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:17:58 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager._thread_info {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:17:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread count: 28 {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 18:17:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread info: [<_MainThread(MainThread, started 139757428633728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 18:17:58 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560" returned: 0 in 0.819s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560.94f1eda1-788b-4007-b98f-22041e71d933 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:58 devstack sudo[98710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560.94f1eda1-788b-4007-b98f-22041e71d933 Jul 10 18:17:58 devstack sudo[98710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c0abc8a2-e08a-44a2-970f-d32949ea5c00 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Acquiring lock "cinder-21a002ed-7e38-47f0-b3fd-d6c30607efa4-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:17:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c0abc8a2-e08a-44a2-970f-d32949ea5c00 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Lock "cinder-21a002ed-7e38-47f0-b3fd-d6c30607efa4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:17:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c0abc8a2-e08a-44a2-970f-d32949ea5c00 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Acquiring lock "cinder-quobyte-21a002ed-7e38-47f0-b3fd-d6c30607efa4" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:17:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c0abc8a2-e08a-44a2-970f-d32949ea5c00 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Lock "cinder-quobyte-21a002ed-7e38-47f0-b3fd-d6c30607efa4" acquired by "delete_volume" :: waited 0.017s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:17:59 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[635cb373-7b94-4188-901b-d3814c720af0]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:17:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c0abc8a2-e08a-44a2-970f-d32949ea5c00 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-21a002ed-7e38-47f0-b3fd-d6c30607efa4 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:59 devstack sudo[98715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-21a002ed-7e38-47f0-b3fd-d6c30607efa4 Jul 10 18:17:59 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:59 devstack sudo[98710]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560.94f1eda1-788b-4007-b98f-22041e71d933" returned: 0 in 0.793s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560.94f1eda1-788b-4007-b98f-22041e71d933 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:59 devstack sudo[98718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560.94f1eda1-788b-4007-b98f-22041e71d933 Jul 10 18:17:59 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:17:59 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c0abc8a2-e08a-44a2-970f-d32949ea5c00 tempest-TestServerVolumeAttachmentScenario-1008122108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-21a002ed-7e38-47f0-b3fd-d6c30607efa4" returned: 0 in 0.805s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:17:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c0abc8a2-e08a-44a2-970f-d32949ea5c00 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-21a002ed-7e38-47f0-b3fd-d6c30607efa4 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:17:59 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root Jul 10 18:17:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560.94f1eda1-788b-4007-b98f-22041e71d933" returned: 0 in 0.689s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:00 devstack sudo[98730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-21a002ed-7e38-47f0-b3fd-d6c30607efa4 Jul 10 18:18:00 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:00 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Lock "cinder-quobyte-94f1eda1-788b-4007-b98f-22041e71d933" released by "_delete_snapshot" :: held 3.150s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:18:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.379s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:18:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.199s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:18:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:17:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-568221925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db4a6fda-eab1-414d-bcbc-14cead251f34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5959ef76a8de4f2cb8e7113819129a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:17:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:17:53Z,use_quota=True,user_id='e9b01c20bfba460389c5557d523f4867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:18:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] Creating volume db4a6fda-eab1-414d-bcbc-14cead251f34 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:18:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:18:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:18:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:18:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:18:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:18:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:18:00 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:18:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db4a6fda-eab1-414d-bcbc-14cead251f34 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:00 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db4a6fda-eab1-414d-bcbc-14cead251f34 1073741824 Jul 10 18:18:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9490e24-00cf-4688-990a-e269a558458c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03f07bac-ee51-45b6-bb65-87e82d16953f', 'volume_size': 1, 'source_volid': 'c9d0260b-7d8e-441e-be6e-4c537d366560', 'source_volstatus': 'available'}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:18:00 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11044912-fdf6-4b6a-86ae-b4f033677347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:18:00 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Volume volume-03f07bac-ee51-45b6-bb65-87e82d16953f (03f07bac-ee51-45b6-bb65-87e82d16953f): created successfully Jul 10 18:18:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11044912-fdf6-4b6a-86ae-b4f033677347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:18:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Flow 'volume_create_manager' (533dce8a-815b-4e6c-9116-d56244c971c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:18:00 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-b6ce4536-1b65-4831-917b-854920f4f606 tempest-VolumesGetTest-1709091377 None] Created volume successfully. Jul 10 18:18:00 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c0abc8a2-e08a-44a2-970f-d32949ea5c00 tempest-TestServerVolumeAttachmentScenario-1008122108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-21a002ed-7e38-47f0-b3fd-d6c30607efa4" returned: 0 in 0.694s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:00 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c0abc8a2-e08a-44a2-970f-d32949ea5c00 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Lock "cinder-quobyte-21a002ed-7e38-47f0-b3fd-d6c30607efa4" released by "delete_volume" :: held 1.543s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:18:00 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-c0abc8a2-e08a-44a2-970f-d32949ea5c00 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Created reservations ['b62b99c7-d966-4603-946c-0d0a6dc1255f', 'fe877664-c3ce-43c6-b336-0cfec2d9eaa6', '37c0a0ef-3534-417b-9904-487d8327e1c4', '4b6a3201-9030-4d84-b011-9f5cdeb257ef'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:18:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c0abc8a2-e08a-44a2-970f-d32949ea5c00 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:18:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c0abc8a2-e08a-44a2-970f-d32949ea5c00 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:18:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c0abc8a2-e08a-44a2-970f-d32949ea5c00 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:18:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c0abc8a2-e08a-44a2-970f-d32949ea5c00 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:18:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c0abc8a2-e08a-44a2-970f-d32949ea5c00 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:18:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c0abc8a2-e08a-44a2-970f-d32949ea5c00 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:00 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:18:00 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:01 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db4a6fda-eab1-414d-bcbc-14cead251f34 1073741824" returned: 0 in 0.978s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db4a6fda-eab1-414d-bcbc-14cead251f34 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:01 devstack sudo[98741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db4a6fda-eab1-414d-bcbc-14cead251f34 Jul 10 18:18:01 devstack sudo[98741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-6a1fc779-d013-4c3f-a789-e18a19d101c0 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Acquiring lock "cinder-676b02f2-1508-4ae1-97a2-ba6ed5191b0d-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:18:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-6a1fc779-d013-4c3f-a789-e18a19d101c0 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Lock "cinder-676b02f2-1508-4ae1-97a2-ba6ed5191b0d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:18:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-6a1fc779-d013-4c3f-a789-e18a19d101c0 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Acquiring lock "cinder-quobyte-676b02f2-1508-4ae1-97a2-ba6ed5191b0d" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:18:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-6a1fc779-d013-4c3f-a789-e18a19d101c0 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Lock "cinder-quobyte-676b02f2-1508-4ae1-97a2-ba6ed5191b0d" acquired by "delete_volume" :: waited 0.024s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:18:01 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d60c8b9-11c0-4414-b03c-1fc5b7780e1c]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:18:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6a1fc779-d013-4c3f-a789-e18a19d101c0 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-676b02f2-1508-4ae1-97a2-ba6ed5191b0d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:01 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:18:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] Flow 'volume_create_manager' (297b5da4-47fe-4828-8d8c-a0ba036f6499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:18:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0a067b-6230-41a2-9ec3-9989ede44c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:18:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0a067b-6230-41a2-9ec3-9989ede44c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:18:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1802098281',display_name='tempest-VolumesGetTest-Volume-1886651489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c9d9ee1-87ca-4a9d-bceb-4c720e7278ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4898665ebdb74705bdae670aa3407916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:18:02Z,use_quota=True,user_id='a7408409b60b40298e22b3506cbdf7a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:18:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a94a0b5-2826-49e3-8f0a-922574a1e677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:18:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a94a0b5-2826-49e3-8f0a-922574a1e677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:18:01 devstack sudo[98744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-676b02f2-1508-4ae1-97a2-ba6ed5191b0d Jul 10 18:18:01 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af741555-58ca-42a4-b0ec-b16145da6a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:18:01 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af741555-58ca-42a4-b0ec-b16145da6a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c9d9ee1-87ca-4a9d-bceb-4c720e7278ed', 'volume_name': 'volume-6c9d9ee1-87ca-4a9d-bceb-4c720e7278ed', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:18:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b987a2f7-9650-4793-b571-05c36de396e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:18:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b987a2f7-9650-4793-b571-05c36de396e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:18:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f45155-c1a3-46f6-8c77-19d5e28ac1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:18:01 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] Volume 6c9d9ee1-87ca-4a9d-bceb-4c720e7278ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c9d9ee1-87ca-4a9d-bceb-4c720e7278ed', 'volume_size': 1} Jul 10 18:18:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:18:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c0abc8a2-e08a-44a2-970f-d32949ea5c00 tempest-TestServerVolumeAttachmentScenario-1008122108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.883s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:01 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-c0abc8a2-e08a-44a2-970f-d32949ea5c00 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:18:01 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-c0abc8a2-e08a-44a2-970f-d32949ea5c00 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Deleted volume successfully. Jul 10 18:18:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c0abc8a2-e08a-44a2-970f-d32949ea5c00 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Lock "cinder-21a002ed-7e38-47f0-b3fd-d6c30607efa4-delete_volume" released by "delete_volume" :: held 2.638s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:18:02 devstack sudo[98741]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db4a6fda-eab1-414d-bcbc-14cead251f34" returned: 0 in 0.901s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] <== create_volume: return (1931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:18:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:18:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.322s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:18:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:18:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1802098281',display_name='tempest-VolumesGetTest-Volume-1886651489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c9d9ee1-87ca-4a9d-bceb-4c720e7278ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4898665ebdb74705bdae670aa3407916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:18:02Z,use_quota=True,user_id='a7408409b60b40298e22b3506cbdf7a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:18:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] Creating volume 6c9d9ee1-87ca-4a9d-bceb-4c720e7278ed {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:18:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:18:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:18:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:18:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:18:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:18:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:18:02 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:18:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6c9d9ee1-87ca-4a9d-bceb-4c720e7278ed 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:02 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c0f6efd-5667-4221-b9b4-0d643b0314ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db4a6fda-eab1-414d-bcbc-14cead251f34', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:18:02 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf48c2b-8885-4c2e-9526-1b4920e77d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:18:02 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6c9d9ee1-87ca-4a9d-bceb-4c720e7278ed 1073741824 Jul 10 18:18:02 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] Volume volume-db4a6fda-eab1-414d-bcbc-14cead251f34 (db4a6fda-eab1-414d-bcbc-14cead251f34): created successfully Jul 10 18:18:02 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:02 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf48c2b-8885-4c2e-9526-1b4920e77d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:18:02 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] Flow 'volume_create_manager' (de37da3a-17cd-4fc1-b129-edf0a2a7a631) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:18:02 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-01444b90-0f34-4de5-b25e-0d8f56d62c10 tempest-AttachVolumeNegativeTest-1182710662 None] Created volume successfully. Jul 10 18:18:02 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6a1fc779-d013-4c3f-a789-e18a19d101c0 tempest-TestServerVolumeAttachmentScenario-1008122108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-676b02f2-1508-4ae1-97a2-ba6ed5191b0d" returned: 0 in 0.894s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6a1fc779-d013-4c3f-a789-e18a19d101c0 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-676b02f2-1508-4ae1-97a2-ba6ed5191b0d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:02 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-676b02f2-1508-4ae1-97a2-ba6ed5191b0d Jul 10 18:18:02 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:02 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6c9d9ee1-87ca-4a9d-bceb-4c720e7278ed 1073741824" returned: 0 in 0.934s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6c9d9ee1-87ca-4a9d-bceb-4c720e7278ed {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:03 devstack sudo[98760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6c9d9ee1-87ca-4a9d-bceb-4c720e7278ed Jul 10 18:18:03 devstack sudo[98760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:03 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6a1fc779-d013-4c3f-a789-e18a19d101c0 tempest-TestServerVolumeAttachmentScenario-1008122108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-676b02f2-1508-4ae1-97a2-ba6ed5191b0d" returned: 0 in 0.753s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:03 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-6a1fc779-d013-4c3f-a789-e18a19d101c0 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Lock "cinder-quobyte-676b02f2-1508-4ae1-97a2-ba6ed5191b0d" released by "delete_volume" :: held 1.702s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:18:03 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-6a1fc779-d013-4c3f-a789-e18a19d101c0 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Created reservations ['d6d3880e-eaf9-4411-94f9-75f431df142b', '27974fff-0a66-47d1-ae08-4773e5933bb9', '2bf55d87-29cd-4f5f-8049-888c5fafa53f', 'ad5f491e-737b-418a-a5e9-3aca08c33658'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:18:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6a1fc779-d013-4c3f-a789-e18a19d101c0 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:18:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6a1fc779-d013-4c3f-a789-e18a19d101c0 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:18:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6a1fc779-d013-4c3f-a789-e18a19d101c0 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:18:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6a1fc779-d013-4c3f-a789-e18a19d101c0 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:18:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6a1fc779-d013-4c3f-a789-e18a19d101c0 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:18:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6a1fc779-d013-4c3f-a789-e18a19d101c0 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:03 devstack sudo[98763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:18:03 devstack sudo[98763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:03 devstack sudo[98760]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6c9d9ee1-87ca-4a9d-bceb-4c720e7278ed" returned: 0 in 0.737s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:18:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.725s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:18:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f45155-c1a3-46f6-8c77-19d5e28ac1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c9d9ee1-87ca-4a9d-bceb-4c720e7278ed', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:18:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (618ac9e4-e35c-41d2-af89-82c211900f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:18:03 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] Volume volume-6c9d9ee1-87ca-4a9d-bceb-4c720e7278ed (6c9d9ee1-87ca-4a9d-bceb-4c720e7278ed): created successfully Jul 10 18:18:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (618ac9e4-e35c-41d2-af89-82c211900f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:18:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] Flow 'volume_create_manager' (297b5da4-47fe-4828-8d8c-a0ba036f6499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:18:03 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-53041470-fe58-4482-86d1-d9fd249b1fd6 tempest-VolumesGetTest-1709091377 None] Created volume successfully. Jul 10 18:18:04 devstack sudo[98763]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6a1fc779-d013-4c3f-a789-e18a19d101c0 tempest-TestServerVolumeAttachmentScenario-1008122108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.850s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:04 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-6a1fc779-d013-4c3f-a789-e18a19d101c0 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:18:04 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-6a1fc779-d013-4c3f-a789-e18a19d101c0 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Deleted volume successfully. Jul 10 18:18:04 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-6a1fc779-d013-4c3f-a789-e18a19d101c0 tempest-TestServerVolumeAttachmentScenario-1008122108 None] Lock "cinder-676b02f2-1508-4ae1-97a2-ba6ed5191b0d-delete_volume" released by "delete_volume" :: held 2.852s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:18:05 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3c55bea1-eccc-4654-a78c-3b18b269b8b8 tempest-VolumesGetTest-1709091377 None] Acquiring lock "cinder-6c9d9ee1-87ca-4a9d-bceb-4c720e7278ed-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:18:05 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3c55bea1-eccc-4654-a78c-3b18b269b8b8 tempest-VolumesGetTest-1709091377 None] Lock "cinder-6c9d9ee1-87ca-4a9d-bceb-4c720e7278ed-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:18:05 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3c55bea1-eccc-4654-a78c-3b18b269b8b8 tempest-VolumesGetTest-1709091377 None] Acquiring lock "cinder-quobyte-6c9d9ee1-87ca-4a9d-bceb-4c720e7278ed" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:18:05 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3c55bea1-eccc-4654-a78c-3b18b269b8b8 tempest-VolumesGetTest-1709091377 None] Lock "cinder-quobyte-6c9d9ee1-87ca-4a9d-bceb-4c720e7278ed" acquired by "delete_volume" :: waited 0.021s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:18:05 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b7e24a-db4b-4916-91ea-58cadc888a37]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:18:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3c55bea1-eccc-4654-a78c-3b18b269b8b8 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6c9d9ee1-87ca-4a9d-bceb-4c720e7278ed {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:05 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6c9d9ee1-87ca-4a9d-bceb-4c720e7278ed Jul 10 18:18:05 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-8a25dc20-fa93-4d1e-9a1f-f3602758de5c req-c29df94d-4fc8-4acc-9f13-34d308a28ea8 tempest-AttachVolumeNegativeTest-1182710662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:18:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-8a25dc20-fa93-4d1e-9a1f-f3602758de5c req-c29df94d-4fc8-4acc-9f13-34d308a28ea8 tempest-AttachVolumeNegativeTest-1182710662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:18:05 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6233c5-21dc-4f6f-a863-73e05383f64a]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:18:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-8a25dc20-fa93-4d1e-9a1f-f3602758de5c req-c29df94d-4fc8-4acc-9f13-34d308a28ea8 tempest-AttachVolumeNegativeTest-1182710662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db4a6fda-eab1-414d-bcbc-14cead251f34 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:05 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db4a6fda-eab1-414d-bcbc-14cead251f34 Jul 10 18:18:05 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:05 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3c55bea1-eccc-4654-a78c-3b18b269b8b8 tempest-VolumesGetTest-1709091377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6c9d9ee1-87ca-4a9d-bceb-4c720e7278ed" returned: 0 in 0.847s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3c55bea1-eccc-4654-a78c-3b18b269b8b8 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6c9d9ee1-87ca-4a9d-bceb-4c720e7278ed {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:06 devstack sudo[98793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6c9d9ee1-87ca-4a9d-bceb-4c720e7278ed Jul 10 18:18:06 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:06 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-8a25dc20-fa93-4d1e-9a1f-f3602758de5c req-c29df94d-4fc8-4acc-9f13-34d308a28ea8 tempest-AttachVolumeNegativeTest-1182710662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db4a6fda-eab1-414d-bcbc-14cead251f34" returned: 0 in 0.870s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-8a25dc20-fa93-4d1e-9a1f-f3602758de5c req-c29df94d-4fc8-4acc-9f13-34d308a28ea8 tempest-AttachVolumeNegativeTest-1182710662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.894s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:18:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-8a25dc20-fa93-4d1e-9a1f-f3602758de5c req-c29df94d-4fc8-4acc-9f13-34d308a28ea8 tempest-AttachVolumeNegativeTest-1182710662 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd', 'name': 'volume-db4a6fda-eab1-414d-bcbc-14cead251f34', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3f01b7e1-ec81-4cba-a9ed-97eed962e74b', 'enforce_multipath': True} {{(pid=87399) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 18:18:06 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-8a25dc20-fa93-4d1e-9a1f-f3602758de5c req-c29df94d-4fc8-4acc-9f13-34d308a28ea8 tempest-AttachVolumeNegativeTest-1182710662 None] attachment_update completed successfully. Jul 10 18:18:06 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3c55bea1-eccc-4654-a78c-3b18b269b8b8 tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6c9d9ee1-87ca-4a9d-bceb-4c720e7278ed" returned: 0 in 0.812s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:06 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3c55bea1-eccc-4654-a78c-3b18b269b8b8 tempest-VolumesGetTest-1709091377 None] Lock "cinder-quobyte-6c9d9ee1-87ca-4a9d-bceb-4c720e7278ed" released by "delete_volume" :: held 1.713s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:18:06 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-3c55bea1-eccc-4654-a78c-3b18b269b8b8 tempest-VolumesGetTest-1709091377 None] Created reservations ['aaeb19e3-4b4b-4621-9f59-6ce58f3053fd', '9c46e0fd-c3ff-45a8-b288-787706d9aa7d', 'a831d487-8225-446b-9a94-8c5b13a70a7f', '8eb24097-6013-4adf-85c3-1bad5a1ac347'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:18:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3c55bea1-eccc-4654-a78c-3b18b269b8b8 tempest-VolumesGetTest-1709091377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:18:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3c55bea1-eccc-4654-a78c-3b18b269b8b8 tempest-VolumesGetTest-1709091377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:18:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-3c55bea1-eccc-4654-a78c-3b18b269b8b8 tempest-VolumesGetTest-1709091377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:18:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-3c55bea1-eccc-4654-a78c-3b18b269b8b8 tempest-VolumesGetTest-1709091377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:18:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3c55bea1-eccc-4654-a78c-3b18b269b8b8 tempest-VolumesGetTest-1709091377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:18:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3c55bea1-eccc-4654-a78c-3b18b269b8b8 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:06 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:18:06 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:07 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a08f8763-138e-4d6d-9e57-26c0b8902c4c tempest-VolumesGetTest-1709091377 None] Acquiring lock "cinder-03f07bac-ee51-45b6-bb65-87e82d16953f-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:18:07 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a08f8763-138e-4d6d-9e57-26c0b8902c4c tempest-VolumesGetTest-1709091377 None] Lock "cinder-03f07bac-ee51-45b6-bb65-87e82d16953f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:18:07 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a08f8763-138e-4d6d-9e57-26c0b8902c4c tempest-VolumesGetTest-1709091377 None] Acquiring lock "cinder-quobyte-03f07bac-ee51-45b6-bb65-87e82d16953f" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:18:07 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a08f8763-138e-4d6d-9e57-26c0b8902c4c tempest-VolumesGetTest-1709091377 None] Lock "cinder-quobyte-03f07bac-ee51-45b6-bb65-87e82d16953f" acquired by "delete_volume" :: waited 0.017s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:18:07 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[74457e6d-9530-4581-91e9-b6dea697a711]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:18:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a08f8763-138e-4d6d-9e57-26c0b8902c4c tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-03f07bac-ee51-45b6-bb65-87e82d16953f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:07 devstack sudo[98802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-03f07bac-ee51-45b6-bb65-87e82d16953f Jul 10 18:18:07 devstack sudo[98802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:07 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3c55bea1-eccc-4654-a78c-3b18b269b8b8 tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.839s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:07 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-3c55bea1-eccc-4654-a78c-3b18b269b8b8 tempest-VolumesGetTest-1709091377 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:18:07 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-3c55bea1-eccc-4654-a78c-3b18b269b8b8 tempest-VolumesGetTest-1709091377 None] Deleted volume successfully. Jul 10 18:18:07 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3c55bea1-eccc-4654-a78c-3b18b269b8b8 tempest-VolumesGetTest-1709091377 None] Lock "cinder-6c9d9ee1-87ca-4a9d-bceb-4c720e7278ed-delete_volume" released by "delete_volume" :: held 2.818s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:18:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-b9c4defa-e570-4af2-b00c-e070c9692281 req-406a8276-6a11-4055-b2eb-0a7296bddc48 tempest-TestInstancesWithCinderVolumes-348398060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:18:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-b9c4defa-e570-4af2-b00c-e070c9692281 req-406a8276-6a11-4055-b2eb-0a7296bddc48 tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:18:08 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[471083dc-2a13-4507-a5cf-6f8c7704c4d0]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:18:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-b9c4defa-e570-4af2-b00c-e070c9692281 req-406a8276-6a11-4055-b2eb-0a7296bddc48 tempest-TestInstancesWithCinderVolumes-348398060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf5eec32-9a07-426d-9610-f903cb6f29d3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:08 devstack sudo[98815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf5eec32-9a07-426d-9610-f903cb6f29d3 Jul 10 18:18:08 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:08 devstack sudo[98802]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a08f8763-138e-4d6d-9e57-26c0b8902c4c tempest-VolumesGetTest-1709091377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-03f07bac-ee51-45b6-bb65-87e82d16953f" returned: 0 in 0.942s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a08f8763-138e-4d6d-9e57-26c0b8902c4c tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-03f07bac-ee51-45b6-bb65-87e82d16953f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:08 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-03f07bac-ee51-45b6-bb65-87e82d16953f Jul 10 18:18:08 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:09 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-b9c4defa-e570-4af2-b00c-e070c9692281 req-406a8276-6a11-4055-b2eb-0a7296bddc48 tempest-TestInstancesWithCinderVolumes-348398060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf5eec32-9a07-426d-9610-f903cb6f29d3" returned: 0 in 0.857s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-b9c4defa-e570-4af2-b00c-e070c9692281 req-406a8276-6a11-4055-b2eb-0a7296bddc48 tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.883s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:18:09 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-b9c4defa-e570-4af2-b00c-e070c9692281 req-406a8276-6a11-4055-b2eb-0a7296bddc48 tempest-TestInstancesWithCinderVolumes-348398060 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd', 'name': 'volume-bf5eec32-9a07-426d-9610-f903cb6f29d3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5401dcac-f27d-46cd-9e04-7d3c70ed8dd3', 'enforce_multipath': True} {{(pid=87399) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 18:18:09 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-b9c4defa-e570-4af2-b00c-e070c9692281 req-406a8276-6a11-4055-b2eb-0a7296bddc48 tempest-TestInstancesWithCinderVolumes-348398060 None] attachment_update completed successfully. Jul 10 18:18:09 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a08f8763-138e-4d6d-9e57-26c0b8902c4c tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-03f07bac-ee51-45b6-bb65-87e82d16953f" returned: 0 in 0.776s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:09 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a08f8763-138e-4d6d-9e57-26c0b8902c4c tempest-VolumesGetTest-1709091377 None] Lock "cinder-quobyte-03f07bac-ee51-45b6-bb65-87e82d16953f" released by "delete_volume" :: held 1.783s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:18:09 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-a08f8763-138e-4d6d-9e57-26c0b8902c4c tempest-VolumesGetTest-1709091377 None] Created reservations ['df3b2873-34aa-4b1f-bf20-91e0075366aa', '506c3cf3-1764-4e48-8a56-27f67b02a45a', '5d2a3ef0-8d46-4317-b8e9-ee14bd74fa10', 'b44037a7-5989-4cf6-9831-264282673dd0'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:18:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a08f8763-138e-4d6d-9e57-26c0b8902c4c tempest-VolumesGetTest-1709091377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:18:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a08f8763-138e-4d6d-9e57-26c0b8902c4c tempest-VolumesGetTest-1709091377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:18:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a08f8763-138e-4d6d-9e57-26c0b8902c4c tempest-VolumesGetTest-1709091377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:18:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a08f8763-138e-4d6d-9e57-26c0b8902c4c tempest-VolumesGetTest-1709091377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:18:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a08f8763-138e-4d6d-9e57-26c0b8902c4c tempest-VolumesGetTest-1709091377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:18:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a08f8763-138e-4d6d-9e57-26c0b8902c4c tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:09 devstack sudo[98827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:18:09 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:09 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-9b90ecf5-a895-4015-b7a2-691a1ce81655 tempest-VolumesGetTest-1709091377 None] Acquiring lock "cinder-c9d0260b-7d8e-441e-be6e-4c537d366560-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:18:09 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-9b90ecf5-a895-4015-b7a2-691a1ce81655 tempest-VolumesGetTest-1709091377 None] Lock "cinder-c9d0260b-7d8e-441e-be6e-4c537d366560-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:18:09 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-9b90ecf5-a895-4015-b7a2-691a1ce81655 tempest-VolumesGetTest-1709091377 None] Acquiring lock "cinder-quobyte-c9d0260b-7d8e-441e-be6e-4c537d366560" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:18:09 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-9b90ecf5-a895-4015-b7a2-691a1ce81655 tempest-VolumesGetTest-1709091377 None] Lock "cinder-quobyte-c9d0260b-7d8e-441e-be6e-4c537d366560" acquired by "delete_volume" :: waited 0.018s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:18:09 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[2857ebdd-5c55-4929-bee9-112313433fd4]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:18:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9b90ecf5-a895-4015-b7a2-691a1ce81655 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:10 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560 Jul 10 18:18:10 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:10 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a08f8763-138e-4d6d-9e57-26c0b8902c4c tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.739s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:10 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-a08f8763-138e-4d6d-9e57-26c0b8902c4c tempest-VolumesGetTest-1709091377 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:18:10 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-a08f8763-138e-4d6d-9e57-26c0b8902c4c tempest-VolumesGetTest-1709091377 None] Deleted volume successfully. Jul 10 18:18:10 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a08f8763-138e-4d6d-9e57-26c0b8902c4c tempest-VolumesGetTest-1709091377 None] Lock "cinder-03f07bac-ee51-45b6-bb65-87e82d16953f-delete_volume" released by "delete_volume" :: held 2.748s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:18:10 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9b90ecf5-a895-4015-b7a2-691a1ce81655 tempest-VolumesGetTest-1709091377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560" returned: 0 in 0.940s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9b90ecf5-a895-4015-b7a2-691a1ce81655 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:10 devstack sudo[98838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560 Jul 10 18:18:10 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:11 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9b90ecf5-a895-4015-b7a2-691a1ce81655 tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c9d0260b-7d8e-441e-be6e-4c537d366560" returned: 0 in 0.766s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:11 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-9b90ecf5-a895-4015-b7a2-691a1ce81655 tempest-VolumesGetTest-1709091377 None] Lock "cinder-quobyte-c9d0260b-7d8e-441e-be6e-4c537d366560" released by "delete_volume" :: held 1.771s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:18:11 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-9b90ecf5-a895-4015-b7a2-691a1ce81655 tempest-VolumesGetTest-1709091377 None] Created reservations ['e374c459-93e0-4cf9-aef8-82e8031caac7', 'c11fd95b-c758-47d8-bd61-7cff3c110f4d', 'faf2e775-cd5a-4063-9e05-da796c55991e', '3d438f1b-6271-4267-b094-8d9e742a6f50'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:18:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9b90ecf5-a895-4015-b7a2-691a1ce81655 tempest-VolumesGetTest-1709091377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:18:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9b90ecf5-a895-4015-b7a2-691a1ce81655 tempest-VolumesGetTest-1709091377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:18:11 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9b90ecf5-a895-4015-b7a2-691a1ce81655 tempest-VolumesGetTest-1709091377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:18:11 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9b90ecf5-a895-4015-b7a2-691a1ce81655 tempest-VolumesGetTest-1709091377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:18:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9b90ecf5-a895-4015-b7a2-691a1ce81655 tempest-VolumesGetTest-1709091377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:18:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9b90ecf5-a895-4015-b7a2-691a1ce81655 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:11 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:18:11 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:12 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9b90ecf5-a895-4015-b7a2-691a1ce81655 tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.948s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:12 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-9b90ecf5-a895-4015-b7a2-691a1ce81655 tempest-VolumesGetTest-1709091377 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:18:12 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-9b90ecf5-a895-4015-b7a2-691a1ce81655 tempest-VolumesGetTest-1709091377 None] Deleted volume successfully. Jul 10 18:18:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-9b90ecf5-a895-4015-b7a2-691a1ce81655 tempest-VolumesGetTest-1709091377 None] Lock "cinder-c9d0260b-7d8e-441e-be6e-4c537d366560-delete_volume" released by "delete_volume" :: held 3.005s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:18:13 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:18:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Flow 'volume_create_manager' (c8a3adfa-6922-447b-8f87-1609877f1378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:18:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de16c17e-ff72-415c-9c8b-1c7aa90a5e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:18:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de16c17e-ff72-415c-9c8b-1c7aa90a5e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1806049964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e93c201-8548-4f6a-8b68-e2dfec9cabe3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4898665ebdb74705bdae670aa3407916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:18:13Z,use_quota=True,user_id='a7408409b60b40298e22b3506cbdf7a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:18:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fce83ca-697a-44fa-9c3d-291792e6174d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:18:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fce83ca-697a-44fa-9c3d-291792e6174d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:18:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d80132fc-7f46-47d7-b8f1-1d9eed481281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:18:13 devstack cinder-volume[87399]: DEBUG cinder.image.glance [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Creating Keystone auth plugin from conf {{(pid=87399) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 18:18:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d80132fc-7f46-47d7-b8f1-1d9eed481281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8e93c201-8548-4f6a-8b68-e2dfec9cabe3', 'volume_name': 'volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3', 'volume_size': 1, 'image_id': '54228e05-a815-461c-8a75-0cdb9dee188c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54228e05-a815-461c-8a75-0cdb9dee188c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3cf5ba5785934cbfaf52674b9cb542ec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '54228e05-a815-461c-8a75-0cdb9dee188c', 'created_at': datetime.datetime(2026, 7, 10, 16, 0, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 16, 0, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54228e05-a815-461c-8a75-0cdb9dee188c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:18:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad46059f-f4a1-49c9-948d-ede614d329b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:18:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad46059f-f4a1-49c9-948d-ede614d329b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:18:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66859bc4-ff33-452d-b7f3-3cf7b00759a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:18:13 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Volume 8e93c201-8548-4f6a-8b68-e2dfec9cabe3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3', 'volume_size': 1, 'image_id': '54228e05-a815-461c-8a75-0cdb9dee188c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54228e05-a815-461c-8a75-0cdb9dee188c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3cf5ba5785934cbfaf52674b9cb542ec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '54228e05-a815-461c-8a75-0cdb9dee188c', 'created_at': datetime.datetime(2026, 7, 10, 16, 0, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 16, 0, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54228e05-a815-461c-8a75-0cdb9dee188c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 18:18:13 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Trying to clone 8e93c201-8548-4f6a-8b68-e2dfec9cabe3 from image 54228e05-a815-461c-8a75-0cdb9dee188c at location (None, [{'url': 'file:///opt/stack/data/glance/images/54228e05-a815-461c-8a75-0cdb9dee188c', 'metadata': {}}]). {{(pid=87399) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 18:18:14 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_fttwbfqedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87399) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 18:18:14 devstack cinder-volume[87399]: INFO cinder.image.image_utils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Image download 20.69 MB at 20.69 MB/s Jul 10 18:18:14 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7d303e-5725-48ab-8a21-2f933cdb0f68]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:18:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_fttwbfqedevstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:14 devstack sudo[98846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_fttwbfqedevstack@QuobyteHD Jul 10 18:18:14 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:14 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_fttwbfqedevstack@QuobyteHD" returned: 0 in 0.924s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:15 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Temporary image 54228e05-a815-461c-8a75-0cdb9dee188c is fetched for user a7408409b60b40298e22b3506cbdf7a8. {{(pid=87399) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 18:18:15 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b7bfb7-8032-476d-bb65-296d534c2651]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:18:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_fttwbfqedevstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:15 devstack sudo[98861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_fttwbfqedevstack@QuobyteHD Jul 10 18:18:15 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:15 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_fttwbfqedevstack@QuobyteHD" returned: 0 in 0.830s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:18:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:18:15 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1806049964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e93c201-8548-4f6a-8b68-e2dfec9cabe3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='4898665ebdb74705bdae670aa3407916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:18:13Z,use_quota=True,user_id='a7408409b60b40298e22b3506cbdf7a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:18:15 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Creating volume 8e93c201-8548-4f6a-8b68-e2dfec9cabe3 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:18:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:18:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:18:15 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:18:15 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:18:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:18:15 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:18:15 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:18:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:15 devstack sudo[98870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3 1073741824 Jul 10 18:18:15 devstack sudo[98870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:16 devstack sudo[98870]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3 1073741824" returned: 0 in 0.990s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:17 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3 Jul 10 18:18:17 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:17 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3" returned: 0 in 0.716s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:18:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:18:17 devstack cinder-volume[87399]: DEBUG cinder.volume.volume_utils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Attempting download of 54228e05-a815-461c-8a75-0cdb9dee188c ((None, [{'url': 'file:///opt/stack/data/glance/images/54228e05-a815-461c-8a75-0cdb9dee188c', 'metadata': {}}])) to volume 8e93c201-8548-4f6a-8b68-e2dfec9cabe3. {{(pid=87399) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 18:18:17 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc84955-0967-4e41-9d13-2ebe7dcb9b85]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:18:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54228e05-a815-461c-8a75-0cdb9dee188c_bfmudlok {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:17 devstack sudo[98880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54228e05-a815-461c-8a75-0cdb9dee188c_bfmudlok Jul 10 18:18:17 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-db97adc1-abb4-42a7-b7ac-5877f7888ed0 req-e1fd58b4-2d30-41df-aeca-d571271d013b tempest-TestInstancesWithCinderVolumes-348398060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:18:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-db97adc1-abb4-42a7-b7ac-5877f7888ed0 req-e1fd58b4-2d30-41df-aeca-d571271d013b tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:18:18 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a26ece5-9f09-4db5-a114-3b7df7589854]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:18:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-db97adc1-abb4-42a7-b7ac-5877f7888ed0 req-e1fd58b4-2d30-41df-aeca-d571271d013b tempest-TestInstancesWithCinderVolumes-348398060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fee5fdc9-f34d-4cee-bf2d-77bb3088e995 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:18 devstack sudo[98890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fee5fdc9-f34d-4cee-bf2d-77bb3088e995 Jul 10 18:18:18 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:18 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54228e05-a815-461c-8a75-0cdb9dee188c_bfmudlok" returned: 0 in 0.853s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54228e05-a815-461c-8a75-0cdb9dee188c_bfmudlok {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:18 devstack sudo[98894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54228e05-a815-461c-8a75-0cdb9dee188c_bfmudlok Jul 10 18:18:18 devstack sudo[98894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:19 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-db97adc1-abb4-42a7-b7ac-5877f7888ed0 req-e1fd58b4-2d30-41df-aeca-d571271d013b tempest-TestInstancesWithCinderVolumes-348398060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fee5fdc9-f34d-4cee-bf2d-77bb3088e995" returned: 0 in 0.931s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-db97adc1-abb4-42a7-b7ac-5877f7888ed0 req-e1fd58b4-2d30-41df-aeca-d571271d013b tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.959s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:18:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-db97adc1-abb4-42a7-b7ac-5877f7888ed0 req-e1fd58b4-2d30-41df-aeca-d571271d013b tempest-TestInstancesWithCinderVolumes-348398060 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd', 'name': 'volume-fee5fdc9-f34d-4cee-bf2d-77bb3088e995', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd28ebcac-7f69-4983-99dc-4a5c71297ec8', 'enforce_multipath': True} {{(pid=87399) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 18:18:19 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-db97adc1-abb4-42a7-b7ac-5877f7888ed0 req-e1fd58b4-2d30-41df-aeca-d571271d013b tempest-TestInstancesWithCinderVolumes-348398060 None] attachment_update completed successfully. Jul 10 18:18:19 devstack sudo[98894]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54228e05-a815-461c-8a75-0cdb9dee188c_bfmudlok" returned: 1 in 0.825s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54228e05-a815-461c-8a75-0cdb9dee188c_bfmudlok' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:18:19 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c9e4d1-53cd-45bf-8bf1-32eddf0c98ed]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:18:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_fttwbfqedevstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:19 devstack sudo[98901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_fttwbfqedevstack@QuobyteHD Jul 10 18:18:19 devstack sudo[98901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:20 devstack sudo[98901]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_fttwbfqedevstack@QuobyteHD" returned: 0 in 0.758s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:20 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] 54228e05-a815-461c-8a75-0cdb9dee188c was qcow2, converting to raw {{(pid=87399) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 18:18:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_fttwbfqedevstack@QuobyteHD /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:20 devstack sudo[98906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_fttwbfqedevstack@QuobyteHD /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3 Jul 10 18:18:20 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:22 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_fttwbfqedevstack@QuobyteHD /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3" returned: 0 in 2.703s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:22 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_fttwbfqedevstack@QuobyteHD, size 112.00 MB, duration 2.70 sec, destination /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3 {{(pid=87399) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 18:18:22 devstack cinder-volume[87399]: INFO cinder.image.image_utils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Converted 112.00 MB image at 41.42 MB/s Jul 10 18:18:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:22 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3 1G Jul 10 18:18:22 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:23 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3 1G" returned: 0 in 0.884s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:23 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45ad1f4-3d42-4e6c-b17f-f083776ef536]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:18:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:24 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3 Jul 10 18:18:24 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:25 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3" returned: 0 in 1.183s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:25 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3 Jul 10 18:18:25 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:26 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3" returned: 1 in 1.131s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:18:26 devstack cinder-volume[87399]: DEBUG cinder.volume.volume_utils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Downloaded image 54228e05-a815-461c-8a75-0cdb9dee188c ((None, [{'url': 'file:///opt/stack/data/glance/images/54228e05-a815-461c-8a75-0cdb9dee188c', 'metadata': {}}])) to volume 8e93c201-8548-4f6a-8b68-e2dfec9cabe3 successfully. {{(pid=87399) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 18:18:26 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Temporary image 54228e05-a815-461c-8a75-0cdb9dee188c for user a7408409b60b40298e22b3506cbdf7a8 is deleted. {{(pid=87399) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 18:18:26 devstack cinder-volume[87399]: DEBUG cinder.volume.volume_utils [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Marking volume 8e93c201-8548-4f6a-8b68-e2dfec9cabe3 as bootable. {{(pid=87399) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 18:18:26 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Copying metadata from image 54228e05-a815-461c-8a75-0cdb9dee188c to 8e93c201-8548-4f6a-8b68-e2dfec9cabe3. {{(pid=87399) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 18:18:26 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Creating volume glance metadata for volume 8e93c201-8548-4f6a-8b68-e2dfec9cabe3 backed by image 54228e05-a815-461c-8a75-0cdb9dee188c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '54228e05-a815-461c-8a75-0cdb9dee188c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87399) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 18:18:26 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66859bc4-ff33-452d-b7f3-3cf7b00759a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3', 'volume_size': 1, 'image_id': '54228e05-a815-461c-8a75-0cdb9dee188c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54228e05-a815-461c-8a75-0cdb9dee188c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3cf5ba5785934cbfaf52674b9cb542ec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '54228e05-a815-461c-8a75-0cdb9dee188c', 'created_at': datetime.datetime(2026, 7, 10, 16, 0, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 16, 0, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54228e05-a815-461c-8a75-0cdb9dee188c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:18:26 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c474a8-0f9a-46c7-bf82-e3f2d29b426f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:18:26 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Volume volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3 (8e93c201-8548-4f6a-8b68-e2dfec9cabe3): created successfully Jul 10 18:18:26 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c474a8-0f9a-46c7-bf82-e3f2d29b426f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:18:26 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Flow 'volume_create_manager' (c8a3adfa-6922-447b-8f87-1609877f1378) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:18:26 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-7e90a9dd-26ed-46c9-bff4-0ac9210e5cc6 tempest-VolumesGetTest-1709091377 None] Created volume successfully. Jul 10 18:18:28 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:18:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] Flow 'volume_create_manager' (b88a7c15-38ef-4489-87f9-281d19229a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:18:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8ecd3c1-6db5-40a9-91c2-0770c4d0a7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:18:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8ecd3c1-6db5-40a9-91c2-0770c4d0a7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:18:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1420486726',display_name='tempest-VolumesGetTest-Volume-89744920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b9bece-611d-40e0-998b-b109be2cec37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4898665ebdb74705bdae670aa3407916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:18:28Z,use_quota=True,user_id='a7408409b60b40298e22b3506cbdf7a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:18:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d056834-a075-4ea5-a966-dae1b15be065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:18:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d056834-a075-4ea5-a966-dae1b15be065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:18:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02600e2b-cf3a-46c0-8126-660b7ec9aab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:18:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02600e2b-cf3a-46c0-8126-660b7ec9aab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58b9bece-611d-40e0-998b-b109be2cec37', 'volume_name': 'volume-58b9bece-611d-40e0-998b-b109be2cec37', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:18:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5337338a-2cc5-47f8-bd6b-8711ccb0df09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:18:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5337338a-2cc5-47f8-bd6b-8711ccb0df09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:18:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e78c896f-c7cd-44f6-a01a-abcb8fea0892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:18:28 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] Volume 58b9bece-611d-40e0-998b-b109be2cec37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58b9bece-611d-40e0-998b-b109be2cec37', 'volume_size': 1} Jul 10 18:18:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:18:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:18:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:18:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1420486726',display_name='tempest-VolumesGetTest-Volume-89744920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b9bece-611d-40e0-998b-b109be2cec37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4898665ebdb74705bdae670aa3407916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:18:28Z,use_quota=True,user_id='a7408409b60b40298e22b3506cbdf7a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:18:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] Creating volume 58b9bece-611d-40e0-998b-b109be2cec37 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:18:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:18:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:18:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:18:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:18:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:18:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:18:28 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:18:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-58b9bece-611d-40e0-998b-b109be2cec37 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:28 devstack sudo[98990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-58b9bece-611d-40e0-998b-b109be2cec37 1073741824 Jul 10 18:18:28 devstack sudo[98990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:29 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-517a6594-752c-400d-910b-5de9e5a8c5c7 req-70490145-c54a-4747-a200-9a0083a1cb22 tempest-TestInstancesWithCinderVolumes-348398060 None] Terminate volume connection completed successfully. Jul 10 18:18:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-517a6594-752c-400d-910b-5de9e5a8c5c7 req-70490145-c54a-4747-a200-9a0083a1cb22 tempest-TestInstancesWithCinderVolumes-348398060 None] Deleting attachment 5401dcac-f27d-46cd-9e04-7d3c70ed8dd3. {{(pid=87399) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 18:18:29 devstack sudo[98990]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-58b9bece-611d-40e0-998b-b109be2cec37 1073741824" returned: 0 in 1.471s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-58b9bece-611d-40e0-998b-b109be2cec37 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:30 devstack sudo[99018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-58b9bece-611d-40e0-998b-b109be2cec37 Jul 10 18:18:30 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:30 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-58b9bece-611d-40e0-998b-b109be2cec37" returned: 0 in 0.920s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:30 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] <== create_volume: return (2445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:18:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.448s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:18:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e78c896f-c7cd-44f6-a01a-abcb8fea0892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58b9bece-611d-40e0-998b-b109be2cec37', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:18:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a6fe77-fc80-4c18-bc5d-1823fc305ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:18:31 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] Volume volume-58b9bece-611d-40e0-998b-b109be2cec37 (58b9bece-611d-40e0-998b-b109be2cec37): created successfully Jul 10 18:18:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a6fe77-fc80-4c18-bc5d-1823fc305ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:18:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] Flow 'volume_create_manager' (b88a7c15-38ef-4489-87f9-281d19229a8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:18:31 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-f7b4cbca-f5c7-4027-8a87-ccf9dc24d6ff tempest-VolumesGetTest-1709091377 None] Created volume successfully. Jul 10 18:18:31 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ce98303a-eb10-42f0-b3c0-5b98f7ba416d tempest-TestInstancesWithCinderVolumes-348398060 None] Acquiring lock "cinder-bf5eec32-9a07-426d-9610-f903cb6f29d3-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:18:31 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ce98303a-eb10-42f0-b3c0-5b98f7ba416d tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "cinder-bf5eec32-9a07-426d-9610-f903cb6f29d3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:18:31 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ce98303a-eb10-42f0-b3c0-5b98f7ba416d tempest-TestInstancesWithCinderVolumes-348398060 None] Acquiring lock "cinder-quobyte-bf5eec32-9a07-426d-9610-f903cb6f29d3" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:18:31 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ce98303a-eb10-42f0-b3c0-5b98f7ba416d tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "cinder-quobyte-bf5eec32-9a07-426d-9610-f903cb6f29d3" acquired by "delete_volume" :: waited 0.035s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:18:31 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8ffb50-e970-49a8-a6f8-2d496564a1dc]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:18:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ce98303a-eb10-42f0-b3c0-5b98f7ba416d tempest-TestInstancesWithCinderVolumes-348398060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf5eec32-9a07-426d-9610-f903cb6f29d3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:32 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b02ad573-e014-455e-96b7-55c294c79ad4 tempest-VolumesGetTest-1709091377 None] Acquiring lock "cinder-58b9bece-611d-40e0-998b-b109be2cec37-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:18:32 devstack sudo[99045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf5eec32-9a07-426d-9610-f903cb6f29d3 Jul 10 18:18:32 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:32 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b02ad573-e014-455e-96b7-55c294c79ad4 tempest-VolumesGetTest-1709091377 None] Lock "cinder-58b9bece-611d-40e0-998b-b109be2cec37-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:18:32 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b02ad573-e014-455e-96b7-55c294c79ad4 tempest-VolumesGetTest-1709091377 None] Acquiring lock "cinder-quobyte-58b9bece-611d-40e0-998b-b109be2cec37" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:18:32 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b02ad573-e014-455e-96b7-55c294c79ad4 tempest-VolumesGetTest-1709091377 None] Lock "cinder-quobyte-58b9bece-611d-40e0-998b-b109be2cec37" acquired by "delete_volume" :: waited 0.065s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:18:32 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[9478dae1-b214-47e7-a6e6-62a79f3bdea5]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:18:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b02ad573-e014-455e-96b7-55c294c79ad4 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-58b9bece-611d-40e0-998b-b109be2cec37 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:32 devstack sudo[99049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-58b9bece-611d-40e0-998b-b109be2cec37 Jul 10 18:18:32 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:33 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ce98303a-eb10-42f0-b3c0-5b98f7ba416d tempest-TestInstancesWithCinderVolumes-348398060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf5eec32-9a07-426d-9610-f903cb6f29d3" returned: 0 in 1.688s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ce98303a-eb10-42f0-b3c0-5b98f7ba416d tempest-TestInstancesWithCinderVolumes-348398060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf5eec32-9a07-426d-9610-f903cb6f29d3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:33 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf5eec32-9a07-426d-9610-f903cb6f29d3 Jul 10 18:18:33 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:34 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b02ad573-e014-455e-96b7-55c294c79ad4 tempest-VolumesGetTest-1709091377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-58b9bece-611d-40e0-998b-b109be2cec37" returned: 0 in 1.771s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b02ad573-e014-455e-96b7-55c294c79ad4 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-58b9bece-611d-40e0-998b-b109be2cec37 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:34 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-58b9bece-611d-40e0-998b-b109be2cec37 Jul 10 18:18:34 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:34 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ce98303a-eb10-42f0-b3c0-5b98f7ba416d tempest-TestInstancesWithCinderVolumes-348398060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf5eec32-9a07-426d-9610-f903cb6f29d3" returned: 0 in 1.127s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:34 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ce98303a-eb10-42f0-b3c0-5b98f7ba416d tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "cinder-quobyte-bf5eec32-9a07-426d-9610-f903cb6f29d3" released by "delete_volume" :: held 2.898s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:18:34 devstack cinder-volume[87399]: WARNING cinder.quota [None req-ce98303a-eb10-42f0-b3c0-5b98f7ba416d tempest-TestInstancesWithCinderVolumes-348398060 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-444656113-633477243 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-444656113-633477243, it is now deprecated. Please use the default quota class for default quota. Jul 10 18:18:34 devstack cinder-volume[87399]: WARNING cinder.quota [None req-ce98303a-eb10-42f0-b3c0-5b98f7ba416d tempest-TestInstancesWithCinderVolumes-348398060 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-444656113-633477243 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-444656113-633477243, it is now deprecated. Please use the default quota class for default quota. Jul 10 18:18:34 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-ce98303a-eb10-42f0-b3c0-5b98f7ba416d tempest-TestInstancesWithCinderVolumes-348398060 None] Created reservations ['de08d0ef-24b9-4ed1-a4e7-fbdff5d2e443', '296425b9-ed3f-4a06-9af1-49f25a6632c1', '4e91374e-285c-4391-8fd6-aeb8bed01fa5', 'b6e76bdc-437f-46d0-8a66-552632cbc5a0'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:18:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ce98303a-eb10-42f0-b3c0-5b98f7ba416d tempest-TestInstancesWithCinderVolumes-348398060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:18:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ce98303a-eb10-42f0-b3c0-5b98f7ba416d tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:18:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ce98303a-eb10-42f0-b3c0-5b98f7ba416d tempest-TestInstancesWithCinderVolumes-348398060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:18:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ce98303a-eb10-42f0-b3c0-5b98f7ba416d tempest-TestInstancesWithCinderVolumes-348398060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:18:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ce98303a-eb10-42f0-b3c0-5b98f7ba416d tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:18:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ce98303a-eb10-42f0-b3c0-5b98f7ba416d tempest-TestInstancesWithCinderVolumes-348398060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:35 devstack sudo[99062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:18:35 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:35 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b02ad573-e014-455e-96b7-55c294c79ad4 tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-58b9bece-611d-40e0-998b-b109be2cec37" returned: 0 in 1.797s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:36 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b02ad573-e014-455e-96b7-55c294c79ad4 tempest-VolumesGetTest-1709091377 None] Lock "cinder-quobyte-58b9bece-611d-40e0-998b-b109be2cec37" released by "delete_volume" :: held 3.688s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:18:36 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-b02ad573-e014-455e-96b7-55c294c79ad4 tempest-VolumesGetTest-1709091377 None] Created reservations ['86b48c9d-157c-4611-97e9-329194227d34', '707f4f78-62f7-4f8e-9d47-67380b4e124d', '1e9d94e4-aa4e-4b3a-a5b8-b8910169be88', 'b9349145-7516-4b69-9402-366b70ec59a9'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:18:36 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ce98303a-eb10-42f0-b3c0-5b98f7ba416d tempest-TestInstancesWithCinderVolumes-348398060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.188s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:36 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-ce98303a-eb10-42f0-b3c0-5b98f7ba416d tempest-TestInstancesWithCinderVolumes-348398060 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:18:36 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-ce98303a-eb10-42f0-b3c0-5b98f7ba416d tempest-TestInstancesWithCinderVolumes-348398060 None] Deleted volume successfully. Jul 10 18:18:36 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ce98303a-eb10-42f0-b3c0-5b98f7ba416d tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "cinder-bf5eec32-9a07-426d-9610-f903cb6f29d3-delete_volume" released by "delete_volume" :: held 4.560s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:18:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b02ad573-e014-455e-96b7-55c294c79ad4 tempest-VolumesGetTest-1709091377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:18:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b02ad573-e014-455e-96b7-55c294c79ad4 tempest-VolumesGetTest-1709091377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:18:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b02ad573-e014-455e-96b7-55c294c79ad4 tempest-VolumesGetTest-1709091377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:18:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b02ad573-e014-455e-96b7-55c294c79ad4 tempest-VolumesGetTest-1709091377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:18:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b02ad573-e014-455e-96b7-55c294c79ad4 tempest-VolumesGetTest-1709091377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:18:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b02ad573-e014-455e-96b7-55c294c79ad4 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:36 devstack sudo[99081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:18:36 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:37 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f198e350-2f51-4900-937f-314b61c033a8 tempest-VolumesGetTest-1709091377 None] Acquiring lock "cinder-8e93c201-8548-4f6a-8b68-e2dfec9cabe3-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:18:37 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f198e350-2f51-4900-937f-314b61c033a8 tempest-VolumesGetTest-1709091377 None] Lock "cinder-8e93c201-8548-4f6a-8b68-e2dfec9cabe3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:18:37 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f198e350-2f51-4900-937f-314b61c033a8 tempest-VolumesGetTest-1709091377 None] Acquiring lock "cinder-quobyte-8e93c201-8548-4f6a-8b68-e2dfec9cabe3" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:18:37 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f198e350-2f51-4900-937f-314b61c033a8 tempest-VolumesGetTest-1709091377 None] Lock "cinder-quobyte-8e93c201-8548-4f6a-8b68-e2dfec9cabe3" acquired by "delete_volume" :: waited 0.072s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:18:37 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2115902-5206-4b15-81f2-0360d919dd36]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:18:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f198e350-2f51-4900-937f-314b61c033a8 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:37 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3 Jul 10 18:18:37 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:37 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b02ad573-e014-455e-96b7-55c294c79ad4 tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.464s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:37 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-b02ad573-e014-455e-96b7-55c294c79ad4 tempest-VolumesGetTest-1709091377 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:18:37 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-b02ad573-e014-455e-96b7-55c294c79ad4 tempest-VolumesGetTest-1709091377 None] Deleted volume successfully. Jul 10 18:18:37 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b02ad573-e014-455e-96b7-55c294c79ad4 tempest-VolumesGetTest-1709091377 None] Lock "cinder-58b9bece-611d-40e0-998b-b109be2cec37-delete_volume" released by "delete_volume" :: held 5.694s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:18:38 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f198e350-2f51-4900-937f-314b61c033a8 tempest-VolumesGetTest-1709091377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3" returned: 0 in 1.100s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f198e350-2f51-4900-937f-314b61c033a8 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:38 devstack sudo[99096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3 Jul 10 18:18:38 devstack sudo[99096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:39 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-a586d34c-8af0-48ee-bfc5-eb4003f09574 req-8a992bd3-7a7f-4175-bbd0-ca7c62194c09 tempest-TestInstancesWithCinderVolumes-348398060 None] Terminate volume connection completed successfully. Jul 10 18:18:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-a586d34c-8af0-48ee-bfc5-eb4003f09574 req-8a992bd3-7a7f-4175-bbd0-ca7c62194c09 tempest-TestInstancesWithCinderVolumes-348398060 None] Deleting attachment d28ebcac-7f69-4983-99dc-4a5c71297ec8. {{(pid=87399) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 18:18:39 devstack sudo[99096]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f198e350-2f51-4900-937f-314b61c033a8 tempest-VolumesGetTest-1709091377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3" returned: 1 in 1.286s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f198e350-2f51-4900-937f-314b61c033a8 tempest-VolumesGetTest-1709091377 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:18:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f198e350-2f51-4900-937f-314b61c033a8 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:39 devstack sudo[99104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3 Jul 10 18:18:39 devstack sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:40 devstack sudo[99104]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f198e350-2f51-4900-937f-314b61c033a8 tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8e93c201-8548-4f6a-8b68-e2dfec9cabe3" returned: 0 in 1.142s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:40 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f198e350-2f51-4900-937f-314b61c033a8 tempest-VolumesGetTest-1709091377 None] Lock "cinder-quobyte-8e93c201-8548-4f6a-8b68-e2dfec9cabe3" released by "delete_volume" :: held 3.709s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:18:41 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-f198e350-2f51-4900-937f-314b61c033a8 tempest-VolumesGetTest-1709091377 None] Created reservations ['51be2a9b-1a5b-4e0f-a627-451c3fc89e25', 'c367d6f3-59f1-4cdd-8b72-b70470828a21', '28e948ec-ec1e-4e90-adaa-f891c63e074f', '7199f28e-52c9-428f-8e9f-e070c6ad160d'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:18:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f198e350-2f51-4900-937f-314b61c033a8 tempest-VolumesGetTest-1709091377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:18:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f198e350-2f51-4900-937f-314b61c033a8 tempest-VolumesGetTest-1709091377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:18:41 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f198e350-2f51-4900-937f-314b61c033a8 tempest-VolumesGetTest-1709091377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:18:41 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f198e350-2f51-4900-937f-314b61c033a8 tempest-VolumesGetTest-1709091377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:18:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f198e350-2f51-4900-937f-314b61c033a8 tempest-VolumesGetTest-1709091377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:18:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f198e350-2f51-4900-937f-314b61c033a8 tempest-VolumesGetTest-1709091377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:41 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-62e1b492-70a4-43f3-bc31-e05c23fbd754 tempest-TestInstancesWithCinderVolumes-348398060 None] Acquiring lock "cinder-fee5fdc9-f34d-4cee-bf2d-77bb3088e995-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:18:41 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:18:41 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:41 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-62e1b492-70a4-43f3-bc31-e05c23fbd754 tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "cinder-fee5fdc9-f34d-4cee-bf2d-77bb3088e995-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:18:41 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-62e1b492-70a4-43f3-bc31-e05c23fbd754 tempest-TestInstancesWithCinderVolumes-348398060 None] Acquiring lock "cinder-quobyte-fee5fdc9-f34d-4cee-bf2d-77bb3088e995" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:18:41 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-62e1b492-70a4-43f3-bc31-e05c23fbd754 tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "cinder-quobyte-fee5fdc9-f34d-4cee-bf2d-77bb3088e995" acquired by "delete_volume" :: waited 0.027s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:18:41 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e61ea42-e98a-4818-bee0-4bc37f039bf6]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:18:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-62e1b492-70a4-43f3-bc31-e05c23fbd754 tempest-TestInstancesWithCinderVolumes-348398060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fee5fdc9-f34d-4cee-bf2d-77bb3088e995 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:41 devstack sudo[99109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fee5fdc9-f34d-4cee-bf2d-77bb3088e995 Jul 10 18:18:41 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:42 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f198e350-2f51-4900-937f-314b61c033a8 tempest-VolumesGetTest-1709091377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.341s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:42 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-f198e350-2f51-4900-937f-314b61c033a8 tempest-VolumesGetTest-1709091377 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:18:42 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-f198e350-2f51-4900-937f-314b61c033a8 tempest-VolumesGetTest-1709091377 None] Deleted volume successfully. Jul 10 18:18:42 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f198e350-2f51-4900-937f-314b61c033a8 tempest-VolumesGetTest-1709091377 None] Lock "cinder-8e93c201-8548-4f6a-8b68-e2dfec9cabe3-delete_volume" released by "delete_volume" :: held 5.573s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:18:42 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-62e1b492-70a4-43f3-bc31-e05c23fbd754 tempest-TestInstancesWithCinderVolumes-348398060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fee5fdc9-f34d-4cee-bf2d-77bb3088e995" returned: 0 in 1.469s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-62e1b492-70a4-43f3-bc31-e05c23fbd754 tempest-TestInstancesWithCinderVolumes-348398060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fee5fdc9-f34d-4cee-bf2d-77bb3088e995 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:42 devstack sudo[99115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fee5fdc9-f34d-4cee-bf2d-77bb3088e995 Jul 10 18:18:42 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:44 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-62e1b492-70a4-43f3-bc31-e05c23fbd754 tempest-TestInstancesWithCinderVolumes-348398060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fee5fdc9-f34d-4cee-bf2d-77bb3088e995" returned: 0 in 1.107s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:44 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-62e1b492-70a4-43f3-bc31-e05c23fbd754 tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "cinder-quobyte-fee5fdc9-f34d-4cee-bf2d-77bb3088e995" released by "delete_volume" :: held 2.629s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:18:44 devstack cinder-volume[87399]: WARNING cinder.quota [None req-62e1b492-70a4-43f3-bc31-e05c23fbd754 tempest-TestInstancesWithCinderVolumes-348398060 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1750177925-484545509 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1750177925-484545509, it is now deprecated. Please use the default quota class for default quota. Jul 10 18:18:44 devstack cinder-volume[87399]: WARNING cinder.quota [None req-62e1b492-70a4-43f3-bc31-e05c23fbd754 tempest-TestInstancesWithCinderVolumes-348398060 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1750177925-484545509 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1750177925-484545509, it is now deprecated. Please use the default quota class for default quota. Jul 10 18:18:44 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-62e1b492-70a4-43f3-bc31-e05c23fbd754 tempest-TestInstancesWithCinderVolumes-348398060 None] Created reservations ['bd4d6b23-d637-4c5a-9051-adb5aafcbd9c', 'e4a7b1d8-5d9c-459d-9aec-42a9b7faee9d', '62076cc3-ceb9-4fd3-b680-15d5c6b179ab', '1cb6a5bc-c3e4-4c2d-a6cf-5203546bef1d'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:18:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-62e1b492-70a4-43f3-bc31-e05c23fbd754 tempest-TestInstancesWithCinderVolumes-348398060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:18:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-62e1b492-70a4-43f3-bc31-e05c23fbd754 tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:18:44 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-62e1b492-70a4-43f3-bc31-e05c23fbd754 tempest-TestInstancesWithCinderVolumes-348398060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:18:44 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-62e1b492-70a4-43f3-bc31-e05c23fbd754 tempest-TestInstancesWithCinderVolumes-348398060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:18:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-62e1b492-70a4-43f3-bc31-e05c23fbd754 tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:18:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-62e1b492-70a4-43f3-bc31-e05c23fbd754 tempest-TestInstancesWithCinderVolumes-348398060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:44 devstack sudo[99118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:18:44 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:45 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-62e1b492-70a4-43f3-bc31-e05c23fbd754 tempest-TestInstancesWithCinderVolumes-348398060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.312s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:45 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-62e1b492-70a4-43f3-bc31-e05c23fbd754 tempest-TestInstancesWithCinderVolumes-348398060 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:18:45 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-62e1b492-70a4-43f3-bc31-e05c23fbd754 tempest-TestInstancesWithCinderVolumes-348398060 None] Deleted volume successfully. Jul 10 18:18:45 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-62e1b492-70a4-43f3-bc31-e05c23fbd754 tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "cinder-fee5fdc9-f34d-4cee-bf2d-77bb3088e995-delete_volume" released by "delete_volume" :: held 4.280s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:18:48 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:18:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Flow 'volume_create_manager' (4e57d03f-90fd-409d-9940-96d9e53db06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:18:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae4db507-877b-4c13-9035-1c39af94b2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:18:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae4db507-877b-4c13-9035-1c39af94b2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1502016164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0e1a3d9-dc7e-406f-b246-f535bf020702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='861ed993e179458cb99e09ca40fef196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:18:49Z,use_quota=True,user_id='53c12f5e129441a1bef35b7fca084189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:18:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d336242-b77b-4173-bae7-2ca95a90d530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:18:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d336242-b77b-4173-bae7-2ca95a90d530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:18:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (880294e4-8672-41a6-8dd9-c52af088c2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:18:48 devstack cinder-volume[87399]: DEBUG cinder.image.glance [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Creating Keystone auth plugin from conf {{(pid=87399) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 18:18:49 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (880294e4-8672-41a6-8dd9-c52af088c2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f0e1a3d9-dc7e-406f-b246-f535bf020702', 'volume_name': 'volume-f0e1a3d9-dc7e-406f-b246-f535bf020702', 'volume_size': 1, 'image_id': '54228e05-a815-461c-8a75-0cdb9dee188c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54228e05-a815-461c-8a75-0cdb9dee188c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3cf5ba5785934cbfaf52674b9cb542ec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '54228e05-a815-461c-8a75-0cdb9dee188c', 'created_at': datetime.datetime(2026, 7, 10, 16, 0, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 16, 0, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54228e05-a815-461c-8a75-0cdb9dee188c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:18:49 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c8acc6e-b4e4-4e4c-961e-55bcb80f2c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:18:49 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c8acc6e-b4e4-4e4c-961e-55bcb80f2c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:18:49 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (685e19f9-d87d-43bf-aec1-8c48f5162440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:18:49 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Volume f0e1a3d9-dc7e-406f-b246-f535bf020702: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f0e1a3d9-dc7e-406f-b246-f535bf020702', 'volume_size': 1, 'image_id': '54228e05-a815-461c-8a75-0cdb9dee188c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54228e05-a815-461c-8a75-0cdb9dee188c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3cf5ba5785934cbfaf52674b9cb542ec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '54228e05-a815-461c-8a75-0cdb9dee188c', 'created_at': datetime.datetime(2026, 7, 10, 16, 0, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 16, 0, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54228e05-a815-461c-8a75-0cdb9dee188c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 18:18:49 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Trying to clone f0e1a3d9-dc7e-406f-b246-f535bf020702 from image 54228e05-a815-461c-8a75-0cdb9dee188c at location (None, [{'url': 'file:///opt/stack/data/glance/images/54228e05-a815-461c-8a75-0cdb9dee188c', 'metadata': {}}]). {{(pid=87399) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 18:18:49 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_ukewlt80devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87399) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 18:18:49 devstack cinder-volume[87399]: INFO cinder.image.image_utils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Image download 20.69 MB at 20.69 MB/s Jul 10 18:18:49 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[622ad40e-7b96-48f0-b4c3-d76b99ffa6db]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:18:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_ukewlt80devstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:49 devstack sudo[99210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_ukewlt80devstack@QuobyteHD Jul 10 18:18:49 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:50 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_ukewlt80devstack@QuobyteHD" returned: 0 in 0.885s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:50 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Temporary image 54228e05-a815-461c-8a75-0cdb9dee188c is fetched for user 53c12f5e129441a1bef35b7fca084189. {{(pid=87399) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 18:18:50 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ca8f4d-d8e7-471f-bcac-422bbc2314eb]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:18:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_ukewlt80devstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:50 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_ukewlt80devstack@QuobyteHD Jul 10 18:18:50 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:51 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_ukewlt80devstack@QuobyteHD" returned: 0 in 0.774s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:18:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:18:51 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1502016164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0e1a3d9-dc7e-406f-b246-f535bf020702,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='861ed993e179458cb99e09ca40fef196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:18:49Z,use_quota=True,user_id='53c12f5e129441a1bef35b7fca084189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:18:51 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Creating volume f0e1a3d9-dc7e-406f-b246-f535bf020702 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:18:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:18:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:18:51 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:18:51 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:18:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:18:51 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:18:51 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:18:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:51 devstack sudo[99224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702 1073741824 Jul 10 18:18:51 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:51 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:18:51 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Flow 'volume_create_manager' (db9dcb98-9075-49f8-b132-d4384393ed41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:18:51 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c7f214-4a21-41cf-ac49-18e0cfbdafef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:18:51 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c7f214-4a21-41cf-ac49-18e0cfbdafef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db476a6f-7849-42ca-9e33-9526b8b580d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598d507641254b93b296ebdcd92a0f94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:18:51Z,use_quota=True,user_id='1fd0ca53b7344e69b520cc2e66ca3310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00df1990-bb56-48da-b1da-207c4d80f000),volume_type_id=00df1990-bb56-48da-b1da-207c4d80f000)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:18:51 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77b4bdc1-af26-4f0a-9fe4-7745a754ae32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:18:51 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77b4bdc1-af26-4f0a-9fe4-7745a754ae32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:18:51 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (650ebb31-e6bf-4aee-9de6-30dd338a7b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:18:51 devstack cinder-volume[87399]: DEBUG cinder.image.glance [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Creating Keystone auth plugin from conf {{(pid=87399) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 18:18:51 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-78c339b1-ae2f-466e-99ab-a8b7560870c3 req-07d52390-c3ef-4c82-8654-4e955cc97be4 tempest-TestInstancesWithCinderVolumes-348398060 None] Terminate volume connection completed successfully. Jul 10 18:18:51 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-78c339b1-ae2f-466e-99ab-a8b7560870c3 req-07d52390-c3ef-4c82-8654-4e955cc97be4 tempest-TestInstancesWithCinderVolumes-348398060 None] Deleting attachment 3770bfc5-2c5e-43fa-9485-3ee173c5bc72. {{(pid=87399) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 18:18:51 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (650ebb31-e6bf-4aee-9de6-30dd338a7b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'db476a6f-7849-42ca-9e33-9526b8b580d7', 'volume_name': 'volume-db476a6f-7849-42ca-9e33-9526b8b580d7', 'volume_size': 1, 'image_id': 'f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0cca6ba7d5915640a20a60ab14ac8a09', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '598d507641254b93b296ebdcd92a0f94', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3419055ce0547bc6e4843e6a6eab2e52b9273d5992f622379aff6c2e33d589b730069db812726b837e3e396bf3b09a7ce8901cda0210ac81ac4b5df238f83eab', 'id': 'f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2', 'created_at': datetime.datetime(2026, 7, 10, 16, 18, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 16, 18, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:18:51 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34fd0e0d-6b81-4168-8d1c-e1b7e7eeca23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:18:51 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34fd0e0d-6b81-4168-8d1c-e1b7e7eeca23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:18:51 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (814fe515-1511-413a-9f92-c43b5eb2438d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:18:51 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Volume db476a6f-7849-42ca-9e33-9526b8b580d7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-db476a6f-7849-42ca-9e33-9526b8b580d7', 'volume_size': 1, 'image_id': 'f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0cca6ba7d5915640a20a60ab14ac8a09', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '598d507641254b93b296ebdcd92a0f94', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3419055ce0547bc6e4843e6a6eab2e52b9273d5992f622379aff6c2e33d589b730069db812726b837e3e396bf3b09a7ce8901cda0210ac81ac4b5df238f83eab', 'id': 'f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2', 'created_at': datetime.datetime(2026, 7, 10, 16, 18, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 16, 18, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 10 18:18:51 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Trying to clone db476a6f-7849-42ca-9e33-9526b8b580d7 from image f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2', 'metadata': {}}]). {{(pid=87399) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 18:18:51 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2_ygayajd3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87399) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 18:18:51 devstack cinder-volume[87399]: INFO cinder.image.image_utils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Image download 0.00 MB at 0.00 MB/s Jul 10 18:18:52 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12c0b8f-f0d4-4509-a377-221bdb7b07a5]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:18:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2_ygayajd3devstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:52 devstack sudo[99226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2_ygayajd3devstack@QuobyteHD Jul 10 18:18:52 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:52 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702 1073741824" returned: 0 in 0.920s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:52 devstack sudo[99232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702 Jul 10 18:18:52 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:52 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2_ygayajd3devstack@QuobyteHD" returned: 0 in 0.806s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2_ygayajd3devstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:52 devstack sudo[99236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2_ygayajd3devstack@QuobyteHD Jul 10 18:18:52 devstack sudo[99236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:53 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702" returned: 0 in 0.741s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:53 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:18:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:18:53 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=81,cinder:UPDATE=97,cinder:INSERT=29,cinder:DELETE=12 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:18:53 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=88,cinder:UPDATE=95,cinder:DELETE=2,cinder:INSERT=27 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:18:53 devstack cinder-volume[87399]: DEBUG cinder.volume.volume_utils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Attempting download of 54228e05-a815-461c-8a75-0cdb9dee188c ((None, [{'url': 'file:///opt/stack/data/glance/images/54228e05-a815-461c-8a75-0cdb9dee188c', 'metadata': {}}])) to volume f0e1a3d9-dc7e-406f-b246-f535bf020702. {{(pid=87399) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 18:18:53 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[539a36a3-c489-4f9d-a812-e0b8182bffcd]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:18:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54228e05-a815-461c-8a75-0cdb9dee188c_2r7ykaf0 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:53 devstack sudo[99239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54228e05-a815-461c-8a75-0cdb9dee188c_2r7ykaf0 Jul 10 18:18:53 devstack sudo[99239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:53 devstack sudo[99236]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2_ygayajd3devstack@QuobyteHD" returned: 1 in 0.844s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2_ygayajd3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:18:53 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Temporary image f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2 is fetched for user 1fd0ca53b7344e69b520cc2e66ca3310. {{(pid=87399) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 18:18:53 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[32efd74e-a71f-456d-9db9-b7967890754d]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:18:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2_ygayajd3devstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:53 devstack sudo[99244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2_ygayajd3devstack@QuobyteHD Jul 10 18:18:53 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:54 devstack sudo[99239]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54228e05-a815-461c-8a75-0cdb9dee188c_2r7ykaf0" returned: 0 in 0.837s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54228e05-a815-461c-8a75-0cdb9dee188c_2r7ykaf0 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:54 devstack sudo[99248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54228e05-a815-461c-8a75-0cdb9dee188c_2r7ykaf0 Jul 10 18:18:54 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:54 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2_ygayajd3devstack@QuobyteHD" returned: 0 in 0.857s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2_ygayajd3devstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:54 devstack sudo[99252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2_ygayajd3devstack@QuobyteHD Jul 10 18:18:54 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:54 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54228e05-a815-461c-8a75-0cdb9dee188c_2r7ykaf0" returned: 1 in 0.785s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54228e05-a815-461c-8a75-0cdb9dee188c_2r7ykaf0' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:18:54 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[403adebe-c3e1-41df-86b3-0348aeb5781a]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:18:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_ukewlt80devstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:55 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_ukewlt80devstack@QuobyteHD Jul 10 18:18:55 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5b65a896-89d5-4856-be7f-3099d83aee46 tempest-TestInstancesWithCinderVolumes-348398060 None] Acquiring lock "cinder-73335b52-40f0-4728-b820-e7250c8323d6-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:18:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5b65a896-89d5-4856-be7f-3099d83aee46 tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "cinder-73335b52-40f0-4728-b820-e7250c8323d6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:18:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5b65a896-89d5-4856-be7f-3099d83aee46 tempest-TestInstancesWithCinderVolumes-348398060 None] Acquiring lock "cinder-quobyte-73335b52-40f0-4728-b820-e7250c8323d6" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:18:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5b65a896-89d5-4856-be7f-3099d83aee46 tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "cinder-quobyte-73335b52-40f0-4728-b820-e7250c8323d6" acquired by "delete_volume" :: waited 0.019s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:18:55 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed909e1a-85a5-41e2-99ea-94da8175f178]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:18:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5b65a896-89d5-4856-be7f-3099d83aee46 tempest-TestInstancesWithCinderVolumes-348398060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:55 devstack sudo[99260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6 Jul 10 18:18:55 devstack sudo[99260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:55 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2_ygayajd3devstack@QuobyteHD" returned: 1 in 0.869s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2_ygayajd3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:18:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:18:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:18:55 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db476a6f-7849-42ca-9e33-9526b8b580d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598d507641254b93b296ebdcd92a0f94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:18:51Z,use_quota=True,user_id='1fd0ca53b7344e69b520cc2e66ca3310',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(00df1990-bb56-48da-b1da-207c4d80f000),volume_type_id=00df1990-bb56-48da-b1da-207c4d80f000)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:18:55 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Creating volume db476a6f-7849-42ca-9e33-9526b8b580d7 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:18:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:18:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:18:55 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:18:55 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:18:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:18:55 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:18:55 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:18:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db476a6f-7849-42ca-9e33-9526b8b580d7 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:55 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db476a6f-7849-42ca-9e33-9526b8b580d7 1073741824 Jul 10 18:18:55 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:55 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_ukewlt80devstack@QuobyteHD" returned: 0 in 0.807s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:55 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] 54228e05-a815-461c-8a75-0cdb9dee188c was qcow2, converting to raw {{(pid=87399) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 18:18:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_ukewlt80devstack@QuobyteHD /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:55 devstack sudo[99271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_ukewlt80devstack@QuobyteHD /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702 Jul 10 18:18:55 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:56 devstack sudo[99260]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5b65a896-89d5-4856-be7f-3099d83aee46 tempest-TestInstancesWithCinderVolumes-348398060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6" returned: 0 in 0.813s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5b65a896-89d5-4856-be7f-3099d83aee46 tempest-TestInstancesWithCinderVolumes-348398060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:56 devstack sudo[99278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6 Jul 10 18:18:56 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:56 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db476a6f-7849-42ca-9e33-9526b8b580d7 1073741824" returned: 0 in 0.888s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db476a6f-7849-42ca-9e33-9526b8b580d7 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:56 devstack sudo[99284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db476a6f-7849-42ca-9e33-9526b8b580d7 Jul 10 18:18:56 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:57 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5b65a896-89d5-4856-be7f-3099d83aee46 tempest-TestInstancesWithCinderVolumes-348398060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6" returned: 1 in 0.909s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5b65a896-89d5-4856-be7f-3099d83aee46 tempest-TestInstancesWithCinderVolumes-348398060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:18:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5b65a896-89d5-4856-be7f-3099d83aee46 tempest-TestInstancesWithCinderVolumes-348398060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:57 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6 Jul 10 18:18:57 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:57 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db476a6f-7849-42ca-9e33-9526b8b580d7" returned: 0 in 0.720s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:18:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:18:57 devstack cinder-volume[87399]: DEBUG cinder.volume.volume_utils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Attempting download of f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2 ((None, [{'url': 'file:///opt/stack/data/glance/images/f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2', 'metadata': {}}])) to volume db476a6f-7849-42ca-9e33-9526b8b580d7. {{(pid=87399) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 18:18:57 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ada4ec-431c-4749-9c47-dd6dd98532ad]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:18:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2_10swi98f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:57 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2_10swi98f Jul 10 18:18:57 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:57 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:18:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:18:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:18:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:18:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:18:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:18:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:57 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:18:57 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:57 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5b65a896-89d5-4856-be7f-3099d83aee46 tempest-TestInstancesWithCinderVolumes-348398060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73335b52-40f0-4728-b820-e7250c8323d6" returned: 0 in 0.835s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:57 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_ukewlt80devstack@QuobyteHD /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702" returned: 0 in 2.103s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:57 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_54228e05-a815-461c-8a75-0cdb9dee188c_ukewlt80devstack@QuobyteHD, size 112.00 MB, duration 2.10 sec, destination /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702 {{(pid=87399) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 18:18:57 devstack cinder-volume[87399]: INFO cinder.image.image_utils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Converted 112.00 MB image at 53.23 MB/s Jul 10 18:18:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5b65a896-89d5-4856-be7f-3099d83aee46 tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "cinder-quobyte-73335b52-40f0-4728-b820-e7250c8323d6" released by "delete_volume" :: held 2.646s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:18:57 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702 1G Jul 10 18:18:57 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:57 devstack cinder-volume[87399]: WARNING cinder.quota [None req-5b65a896-89d5-4856-be7f-3099d83aee46 tempest-TestInstancesWithCinderVolumes-348398060 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1134357661-104648292 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1134357661-104648292, it is now deprecated. Please use the default quota class for default quota. Jul 10 18:18:57 devstack cinder-volume[87399]: WARNING cinder.quota [None req-5b65a896-89d5-4856-be7f-3099d83aee46 tempest-TestInstancesWithCinderVolumes-348398060 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1134357661-104648292 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1134357661-104648292, it is now deprecated. Please use the default quota class for default quota. Jul 10 18:18:58 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-5b65a896-89d5-4856-be7f-3099d83aee46 tempest-TestInstancesWithCinderVolumes-348398060 None] Created reservations ['8f9d7b32-0a67-40d7-8f63-5eb89dfc4032', 'ec59119b-bc12-40c6-9640-462ba345d3d8', 'd55287de-5816-42b6-bc73-b3693e31dcc0', '80aa70a3-8334-4403-b9df-5c5ebd0c5eca'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:18:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5b65a896-89d5-4856-be7f-3099d83aee46 tempest-TestInstancesWithCinderVolumes-348398060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:18:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5b65a896-89d5-4856-be7f-3099d83aee46 tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:18:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5b65a896-89d5-4856-be7f-3099d83aee46 tempest-TestInstancesWithCinderVolumes-348398060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:18:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5b65a896-89d5-4856-be7f-3099d83aee46 tempest-TestInstancesWithCinderVolumes-348398060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:18:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5b65a896-89d5-4856-be7f-3099d83aee46 tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:18:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5b65a896-89d5-4856-be7f-3099d83aee46 tempest-TestInstancesWithCinderVolumes-348398060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:58 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:18:58 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:58 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2_10swi98f" returned: 0 in 0.946s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2_10swi98f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:58 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2_10swi98f Jul 10 18:18:58 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:58 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.984s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:58 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:18:58 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager._thread_info {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:18:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread count: 28 {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 18:18:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread info: [<_MainThread(MainThread, started 139757428633728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 18:18:58 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702 1G" returned: 0 in 1.073s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:59 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[b260e82b-0a50-4b0d-908b-0af9beb56df0]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:18:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:59 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5b65a896-89d5-4856-be7f-3099d83aee46 tempest-TestInstancesWithCinderVolumes-348398060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.943s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:59 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-5b65a896-89d5-4856-be7f-3099d83aee46 tempest-TestInstancesWithCinderVolumes-348398060 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:18:59 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-5b65a896-89d5-4856-be7f-3099d83aee46 tempest-TestInstancesWithCinderVolumes-348398060 None] Deleted volume successfully. Jul 10 18:18:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5b65a896-89d5-4856-be7f-3099d83aee46 tempest-TestInstancesWithCinderVolumes-348398060 None] Lock "cinder-73335b52-40f0-4728-b820-e7250c8323d6-delete_volume" released by "delete_volume" :: held 3.933s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:18:59 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702 Jul 10 18:18:59 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:59 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2_10swi98f" returned: 1 in 1.047s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2_10swi98f' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:18:59 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4695a89-8c87-4a5c-a5db-2d8617844858]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:18:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2_ygayajd3devstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:18:59 devstack sudo[99319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2_ygayajd3devstack@QuobyteHD Jul 10 18:18:59 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:18:59 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Jul 10 18:18:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702" returned: 0 in 0.887s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:18:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:00 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702 Jul 10 18:19:00 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:00 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2_ygayajd3devstack@QuobyteHD" returned: 0 in 0.990s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2_ygayajd3devstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:00 devstack sudo[99349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2_ygayajd3devstack@QuobyteHD Jul 10 18:19:00 devstack sudo[99349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:01 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702" returned: 1 in 1.112s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:19:01 devstack cinder-volume[87399]: DEBUG cinder.volume.volume_utils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Downloaded image 54228e05-a815-461c-8a75-0cdb9dee188c ((None, [{'url': 'file:///opt/stack/data/glance/images/54228e05-a815-461c-8a75-0cdb9dee188c', 'metadata': {}}])) to volume f0e1a3d9-dc7e-406f-b246-f535bf020702 successfully. {{(pid=87399) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 18:19:01 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Temporary image 54228e05-a815-461c-8a75-0cdb9dee188c for user 53c12f5e129441a1bef35b7fca084189 is deleted. {{(pid=87399) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 18:19:01 devstack cinder-volume[87399]: DEBUG cinder.volume.volume_utils [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Marking volume f0e1a3d9-dc7e-406f-b246-f535bf020702 as bootable. {{(pid=87399) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 18:19:01 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Copying metadata from image 54228e05-a815-461c-8a75-0cdb9dee188c to f0e1a3d9-dc7e-406f-b246-f535bf020702. {{(pid=87399) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 18:19:01 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Creating volume glance metadata for volume f0e1a3d9-dc7e-406f-b246-f535bf020702 backed by image 54228e05-a815-461c-8a75-0cdb9dee188c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '54228e05-a815-461c-8a75-0cdb9dee188c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87399) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 18:19:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (685e19f9-d87d-43bf-aec1-8c48f5162440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0e1a3d9-dc7e-406f-b246-f535bf020702', 'volume_size': 1, 'image_id': '54228e05-a815-461c-8a75-0cdb9dee188c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54228e05-a815-461c-8a75-0cdb9dee188c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3cf5ba5785934cbfaf52674b9cb542ec', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '54228e05-a815-461c-8a75-0cdb9dee188c', 'created_at': datetime.datetime(2026, 7, 10, 16, 0, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 16, 0, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54228e05-a815-461c-8a75-0cdb9dee188c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb99c0a4-4b05-4a82-874b-50d8426e4eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:01 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Volume volume-f0e1a3d9-dc7e-406f-b246-f535bf020702 (f0e1a3d9-dc7e-406f-b246-f535bf020702): created successfully Jul 10 18:19:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb99c0a4-4b05-4a82-874b-50d8426e4eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Flow 'volume_create_manager' (4e57d03f-90fd-409d-9940-96d9e53db06c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:19:01 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-f4aa2771-816f-4e57-b5b3-b8ad23f5ba42 tempest-TestShelveInstance-1977941275 None] Created volume successfully. Jul 10 18:19:01 devstack sudo[99349]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2_ygayajd3devstack@QuobyteHD" returned: 1 in 1.041s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2_ygayajd3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:19:01 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2 was raw, converting to raw {{(pid=87399) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 18:19:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2_ygayajd3devstack@QuobyteHD /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db476a6f-7849-42ca-9e33-9526b8b580d7 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:01 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2_ygayajd3devstack@QuobyteHD /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db476a6f-7849-42ca-9e33-9526b8b580d7 Jul 10 18:19:01 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:02 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2_ygayajd3devstack@QuobyteHD /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db476a6f-7849-42ca-9e33-9526b8b580d7" returned: 0 in 0.969s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:02 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2_ygayajd3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db476a6f-7849-42ca-9e33-9526b8b580d7 {{(pid=87399) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 18:19:02 devstack cinder-volume[87399]: INFO cinder.image.image_utils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 18:19:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db476a6f-7849-42ca-9e33-9526b8b580d7 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:02 devstack sudo[99374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db476a6f-7849-42ca-9e33-9526b8b580d7 1G Jul 10 18:19:02 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:03 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db476a6f-7849-42ca-9e33-9526b8b580d7 1G" returned: 0 in 0.792s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:03 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[276780a5-a648-427e-a9f0-b35a08406893]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:19:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db476a6f-7849-42ca-9e33-9526b8b580d7 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:03 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db476a6f-7849-42ca-9e33-9526b8b580d7 Jul 10 18:19:03 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:04 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db476a6f-7849-42ca-9e33-9526b8b580d7" returned: 0 in 0.966s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db476a6f-7849-42ca-9e33-9526b8b580d7 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:04 devstack sudo[99386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db476a6f-7849-42ca-9e33-9526b8b580d7 Jul 10 18:19:04 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:05 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db476a6f-7849-42ca-9e33-9526b8b580d7" returned: 1 in 0.933s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db476a6f-7849-42ca-9e33-9526b8b580d7' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:19:05 devstack cinder-volume[87399]: DEBUG cinder.volume.volume_utils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Downloaded image f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2 ((None, [{'url': 'file:///opt/stack/data/glance/images/f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2', 'metadata': {}}])) to volume db476a6f-7849-42ca-9e33-9526b8b580d7 successfully. {{(pid=87399) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 18:19:05 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Temporary image f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2 for user 1fd0ca53b7344e69b520cc2e66ca3310 is deleted. {{(pid=87399) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 18:19:05 devstack cinder-volume[87399]: DEBUG cinder.volume.volume_utils [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Marking volume db476a6f-7849-42ca-9e33-9526b8b580d7 as bootable. {{(pid=87399) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 18:19:05 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Copying metadata from image f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2 to db476a6f-7849-42ca-9e33-9526b8b580d7. {{(pid=87399) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 18:19:05 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Creating volume glance metadata for volume db476a6f-7849-42ca-9e33-9526b8b580d7 backed by image f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0cca6ba7d5915640a20a60ab14ac8a09', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87399) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 18:19:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (814fe515-1511-413a-9f92-c43b5eb2438d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db476a6f-7849-42ca-9e33-9526b8b580d7', 'volume_size': 1, 'image_id': 'f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0cca6ba7d5915640a20a60ab14ac8a09', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '598d507641254b93b296ebdcd92a0f94', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3419055ce0547bc6e4843e6a6eab2e52b9273d5992f622379aff6c2e33d589b730069db812726b837e3e396bf3b09a7ce8901cda0210ac81ac4b5df238f83eab', 'id': 'f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2', 'created_at': datetime.datetime(2026, 7, 10, 16, 18, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 16, 18, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f23e1fa8-3100-45ea-a3d9-31f5c6fc5cc2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa05cee1-0b16-40b7-a067-8915308b405b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:05 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Volume volume-db476a6f-7849-42ca-9e33-9526b8b580d7 (db476a6f-7849-42ca-9e33-9526b8b580d7): created successfully Jul 10 18:19:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa05cee1-0b16-40b7-a067-8915308b405b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Flow 'volume_create_manager' (db9dcb98-9075-49f8-b132-d4384393ed41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:19:05 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-42480b6a-ed7d-4e6b-adcc-6dcfe1d621b8 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Created volume successfully. Jul 10 18:19:05 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-20513000-f9f1-4587-bb42-e96f84f39d58 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Acquiring lock "cinder-db476a6f-7849-42ca-9e33-9526b8b580d7-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:19:05 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-20513000-f9f1-4587-bb42-e96f84f39d58 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Lock "cinder-db476a6f-7849-42ca-9e33-9526b8b580d7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:19:05 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-20513000-f9f1-4587-bb42-e96f84f39d58 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Acquiring lock "cinder-quobyte-db476a6f-7849-42ca-9e33-9526b8b580d7" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:19:05 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-20513000-f9f1-4587-bb42-e96f84f39d58 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Lock "cinder-quobyte-db476a6f-7849-42ca-9e33-9526b8b580d7" acquired by "delete_volume" :: waited 0.015s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:19:06 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9e1ac6-8f96-4696-a963-bce049f9749d]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:19:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-20513000-f9f1-4587-bb42-e96f84f39d58 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db476a6f-7849-42ca-9e33-9526b8b580d7 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:06 devstack sudo[99393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db476a6f-7849-42ca-9e33-9526b8b580d7 Jul 10 18:19:06 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:06 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-20513000-f9f1-4587-bb42-e96f84f39d58 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db476a6f-7849-42ca-9e33-9526b8b580d7" returned: 0 in 0.875s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-20513000-f9f1-4587-bb42-e96f84f39d58 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db476a6f-7849-42ca-9e33-9526b8b580d7 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:07 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db476a6f-7849-42ca-9e33-9526b8b580d7 Jul 10 18:19:07 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:07 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-20513000-f9f1-4587-bb42-e96f84f39d58 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db476a6f-7849-42ca-9e33-9526b8b580d7" returned: 1 in 0.882s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-20513000-f9f1-4587-bb42-e96f84f39d58 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db476a6f-7849-42ca-9e33-9526b8b580d7' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:19:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-20513000-f9f1-4587-bb42-e96f84f39d58 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db476a6f-7849-42ca-9e33-9526b8b580d7 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:07 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db476a6f-7849-42ca-9e33-9526b8b580d7 Jul 10 18:19:07 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:08 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-2d04b9f7-4180-4711-a4e7-604092c4ff6f req-d0cfe555-1406-41b7-8949-63a09d131d5e tempest-AttachVolumeNegativeTest-1182710662 None] Terminate volume connection completed successfully. Jul 10 18:19:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-2d04b9f7-4180-4711-a4e7-604092c4ff6f req-d0cfe555-1406-41b7-8949-63a09d131d5e tempest-AttachVolumeNegativeTest-1182710662 None] Deleting attachment 3f01b7e1-ec81-4cba-a9ed-97eed962e74b. {{(pid=87399) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 18:19:08 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-20513000-f9f1-4587-bb42-e96f84f39d58 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db476a6f-7849-42ca-9e33-9526b8b580d7" returned: 0 in 0.934s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:08 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-20513000-f9f1-4587-bb42-e96f84f39d58 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Lock "cinder-quobyte-db476a6f-7849-42ca-9e33-9526b8b580d7" released by "delete_volume" :: held 2.785s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:19:08 devstack cinder-volume[87399]: WARNING cinder.quota [None req-20513000-f9f1-4587-bb42-e96f84f39d58 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 10 18:19:08 devstack cinder-volume[87399]: WARNING cinder.quota [None req-20513000-f9f1-4587-bb42-e96f84f39d58 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 10 18:19:08 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-20513000-f9f1-4587-bb42-e96f84f39d58 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Created reservations ['72d6575b-9f06-42c8-ac16-6e5cfe45960f', '8e56ef0f-9f8d-415f-b201-b97d2adeb3da', '41ff6127-4be4-4e9c-be59-a262ad316f3f', 'd128df22-f301-40bf-9af8-7610eeb3b239'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:19:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-20513000-f9f1-4587-bb42-e96f84f39d58 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:19:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-20513000-f9f1-4587-bb42-e96f84f39d58 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:19:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-20513000-f9f1-4587-bb42-e96f84f39d58 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:19:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-20513000-f9f1-4587-bb42-e96f84f39d58 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:19:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-20513000-f9f1-4587-bb42-e96f84f39d58 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:19:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-20513000-f9f1-4587-bb42-e96f84f39d58 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:09 devstack sudo[99409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:19:09 devstack sudo[99409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-6611643b-2122-4bbe-b72b-f7814c726f36 req-8c20a71a-8293-4c60-ba49-764fc91fdb23 tempest-TestShelveInstance-1977941275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:19:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-6611643b-2122-4bbe-b72b-f7814c726f36 req-8c20a71a-8293-4c60-ba49-764fc91fdb23 tempest-TestShelveInstance-1977941275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:19:09 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad15087-0352-4839-b096-f549a034a8e4]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:19:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-6611643b-2122-4bbe-b72b-f7814c726f36 req-8c20a71a-8293-4c60-ba49-764fc91fdb23 tempest-TestShelveInstance-1977941275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:10 devstack sudo[99409]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-20513000-f9f1-4587-bb42-e96f84f39d58 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.111s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:10 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-20513000-f9f1-4587-bb42-e96f84f39d58 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:19:10 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-20513000-f9f1-4587-bb42-e96f84f39d58 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Deleted volume successfully. Jul 10 18:19:10 devstack sudo[99421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702 Jul 10 18:19:10 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:10 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-20513000-f9f1-4587-bb42-e96f84f39d58 tempest-VolumeAndVolumeTypeFromImageTest-1533068729 None] Lock "cinder-db476a6f-7849-42ca-9e33-9526b8b580d7-delete_volume" released by "delete_volume" :: held 4.261s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:19:11 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-6611643b-2122-4bbe-b72b-f7814c726f36 req-8c20a71a-8293-4c60-ba49-764fc91fdb23 tempest-TestShelveInstance-1977941275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702" returned: 0 in 1.305s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-6611643b-2122-4bbe-b72b-f7814c726f36 req-8c20a71a-8293-4c60-ba49-764fc91fdb23 tempest-TestShelveInstance-1977941275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:11 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702 Jul 10 18:19:11 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:12 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-6611643b-2122-4bbe-b72b-f7814c726f36 req-8c20a71a-8293-4c60-ba49-764fc91fdb23 tempest-TestShelveInstance-1977941275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702" returned: 1 in 0.966s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-6611643b-2122-4bbe-b72b-f7814c726f36 req-8c20a71a-8293-4c60-ba49-764fc91fdb23 tempest-TestShelveInstance-1977941275 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:19:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-6611643b-2122-4bbe-b72b-f7814c726f36 req-8c20a71a-8293-4c60-ba49-764fc91fdb23 tempest-TestShelveInstance-1977941275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.354s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:19:12 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-6611643b-2122-4bbe-b72b-f7814c726f36 req-8c20a71a-8293-4c60-ba49-764fc91fdb23 tempest-TestShelveInstance-1977941275 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd', 'name': 'volume-f0e1a3d9-dc7e-406f-b246-f535bf020702', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c9e37566-2090-42fb-a2c9-f0ce6799ab4e', 'enforce_multipath': True} {{(pid=87399) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 18:19:12 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-6611643b-2122-4bbe-b72b-f7814c726f36 req-8c20a71a-8293-4c60-ba49-764fc91fdb23 tempest-TestShelveInstance-1977941275 None] attachment_update completed successfully. Jul 10 18:19:15 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:19:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] Flow 'volume_create_manager' (491f97b3-845a-4a7a-af06-13daaa88ada6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:19:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45a4480c-062a-4d44-b265-ffe6d929d2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45a4480c-062a-4d44-b265-ffe6d929d2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-501030005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a26a6d86-feab-4ab8-a766-5698a2058e4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df208950d0de4e5c93eb90d9e3dacfb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:19:15Z,use_quota=True,user_id='4bcc2cca0f8940e4b61abc91cec021a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33bc2e23-c69d-47d5-9f76-ba18b1f762a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33bc2e23-c69d-47d5-9f76-ba18b1f762a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2472360-e39b-45a8-af56-944ed6a7a24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2472360-e39b-45a8-af56-944ed6a7a24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a26a6d86-feab-4ab8-a766-5698a2058e4b', 'volume_name': 'volume-a26a6d86-feab-4ab8-a766-5698a2058e4b', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf253876-6ab6-4d83-babf-4bcdd2f48d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf253876-6ab6-4d83-babf-4bcdd2f48d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b166fce5-2b2c-4f06-af11-7c506e39711d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:15 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] Volume a26a6d86-feab-4ab8-a766-5698a2058e4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a26a6d86-feab-4ab8-a766-5698a2058e4b', 'volume_size': 1} Jul 10 18:19:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:19:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:19:15 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-501030005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a26a6d86-feab-4ab8-a766-5698a2058e4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df208950d0de4e5c93eb90d9e3dacfb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:19:15Z,use_quota=True,user_id='4bcc2cca0f8940e4b61abc91cec021a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:19:15 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] Creating volume a26a6d86-feab-4ab8-a766-5698a2058e4b {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:19:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:19:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:19:15 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:19:15 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:19:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:19:15 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:19:15 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:19:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:15 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b 1073741824 Jul 10 18:19:15 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:16 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b 1073741824" returned: 0 in 1.061s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:16 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b Jul 10 18:19:16 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:16 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:19:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] Flow 'volume_create_manager' (802f84bb-cbfe-4309-8770-3e4f37f1d4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:19:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c5905a6-def2-498e-9202-5d02d66fd74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c5905a6-def2-498e-9202-5d02d66fd74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-692879958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22f960e4-1d51-4b86-b7af-7cffe4ad1fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f915f256fc75468685c4a9915c05ae45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:19:16Z,use_quota=True,user_id='389a6ea0f64a44c1b8660d56722de984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c132f39-f355-4398-8bbe-658c4553858f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c132f39-f355-4398-8bbe-658c4553858f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edc9c2b9-909b-4cc6-ac21-481834a357c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edc9c2b9-909b-4cc6-ac21-481834a357c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22f960e4-1d51-4b86-b7af-7cffe4ad1fda', 'volume_name': 'volume-22f960e4-1d51-4b86-b7af-7cffe4ad1fda', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfcaca3d-37dd-4cac-a7aa-fed3bf5a54ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfcaca3d-37dd-4cac-a7aa-fed3bf5a54ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8543326f-01dd-4f90-8274-e8720de4036d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:16 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] Volume 22f960e4-1d51-4b86-b7af-7cffe4ad1fda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22f960e4-1d51-4b86-b7af-7cffe4ad1fda', 'volume_size': 1} Jul 10 18:19:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:19:17 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:19:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] Flow 'volume_create_manager' (bcccbd5c-4e2d-4039-bdcc-6220f33d4479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:19:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa28da97-ccc1-4bfd-a0d5-dc7eb2fb9902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa28da97-ccc1-4bfd-a0d5-dc7eb2fb9902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1585198218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73f23d45-0657-424b-9f3b-09f2c7099416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f915f256fc75468685c4a9915c05ae45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:19:17Z,use_quota=True,user_id='389a6ea0f64a44c1b8660d56722de984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (847e1c75-c023-4a7d-b39e-abd62aeedee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (847e1c75-c023-4a7d-b39e-abd62aeedee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19cd9ab0-848a-4e3f-bfac-a43a3806239d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19cd9ab0-848a-4e3f-bfac-a43a3806239d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73f23d45-0657-424b-9f3b-09f2c7099416', 'volume_name': 'volume-73f23d45-0657-424b-9f3b-09f2c7099416', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (870a0a80-cc76-413d-bc3d-6af34faabbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (870a0a80-cc76-413d-bc3d-6af34faabbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2faf0ace-81e5-4fd0-9943-0483dd9f647f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:17 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] Volume 73f23d45-0657-424b-9f3b-09f2c7099416: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73f23d45-0657-424b-9f3b-09f2c7099416', 'volume_size': 1} Jul 10 18:19:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:19:17 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:19:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] Flow 'volume_create_manager' (9eb6f440-be64-442f-bcbf-cef74e0ec92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:19:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e48d6e9e-4748-490e-8caf-0b898f2876f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e48d6e9e-4748-490e-8caf-0b898f2876f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-437193636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b63c1f7-ffb9-487c-a4a1-4ce3d3e5e8c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f915f256fc75468685c4a9915c05ae45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:19:18Z,use_quota=True,user_id='389a6ea0f64a44c1b8660d56722de984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc4ee49-d81a-4dad-be35-d7de3af86145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acc4ee49-d81a-4dad-be35-d7de3af86145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb943278-ab1d-44c2-a7bf-4a90573c8fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb943278-ab1d-44c2-a7bf-4a90573c8fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b63c1f7-ffb9-487c-a4a1-4ce3d3e5e8c1', 'volume_name': 'volume-8b63c1f7-ffb9-487c-a4a1-4ce3d3e5e8c1', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00d075bf-977a-48e3-b552-3315c901cab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00d075bf-977a-48e3-b552-3315c901cab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23090ba5-0ebc-494f-9f7a-96689ba85599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:17 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] Volume 8b63c1f7-ffb9-487c-a4a1-4ce3d3e5e8c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b63c1f7-ffb9-487c-a4a1-4ce3d3e5e8c1', 'volume_size': 1} Jul 10 18:19:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:19:17 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b" returned: 0 in 1.567s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] <== create_volume: return (2688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:19:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.691s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:19:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.446s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:19:18 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-692879958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22f960e4-1d51-4b86-b7af-7cffe4ad1fda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f915f256fc75468685c4a9915c05ae45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:19:16Z,use_quota=True,user_id='389a6ea0f64a44c1b8660d56722de984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:19:18 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] Creating volume 22f960e4-1d51-4b86-b7af-7cffe4ad1fda {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:19:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:19:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:19:18 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:19:18 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:19:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:19:18 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:19:18 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:19:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-22f960e4-1d51-4b86-b7af-7cffe4ad1fda 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b166fce5-2b2c-4f06-af11-7c506e39711d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a26a6d86-feab-4ab8-a766-5698a2058e4b', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:18 devstack sudo[99577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-22f960e4-1d51-4b86-b7af-7cffe4ad1fda 1073741824 Jul 10 18:19:18 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b45a3d-6a7a-493a-a148-71de07fd7e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:18 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] Volume volume-a26a6d86-feab-4ab8-a766-5698a2058e4b (a26a6d86-feab-4ab8-a766-5698a2058e4b): created successfully Jul 10 18:19:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b45a3d-6a7a-493a-a148-71de07fd7e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] Flow 'volume_create_manager' (491f97b3-845a-4a7a-af06-13daaa88ada6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:19:18 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-fd91421e-88cb-4c8a-9a63-4a7a5cf47323 tempest-VolumeDependencyTests-1626197307 None] Created volume successfully. Jul 10 18:19:18 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:19:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] Flow 'volume_create_manager' (e564bb6a-4a59-4ac2-9b50-6d683837f253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:19:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07508232-6e15-4c9a-8d32-8d3541c2d811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07508232-6e15-4c9a-8d32-8d3541c2d811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1813146125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7649ebc1-3996-45ca-8cde-cdb42e08e5c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f915f256fc75468685c4a9915c05ae45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:19:18Z,use_quota=True,user_id='389a6ea0f64a44c1b8660d56722de984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0efb5d68-b3f7-4324-9f76-5553e7e38ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0efb5d68-b3f7-4324-9f76-5553e7e38ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11120f2f-39c2-4465-bac1-c29ac73d11e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11120f2f-39c2-4465-bac1-c29ac73d11e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7649ebc1-3996-45ca-8cde-cdb42e08e5c1', 'volume_name': 'volume-7649ebc1-3996-45ca-8cde-cdb42e08e5c1', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84ea4a4d-d262-4584-96a7-1b1ce0ded506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84ea4a4d-d262-4584-96a7-1b1ce0ded506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c26667-dbad-4cdc-bd4a-4e4dda521260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:18 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] Volume 7649ebc1-3996-45ca-8cde-cdb42e08e5c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7649ebc1-3996-45ca-8cde-cdb42e08e5c1', 'volume_size': 1} Jul 10 18:19:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:19:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d920d8d0-d7c1-49fc-840a-c977d77f5c45 tempest-VolumeDependencyTests-1626197307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:19:19 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:19:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] Flow 'volume_create_manager' (78e8dbc6-a54b-4316-a2c1-e626928e4896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:19:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69be15d4-1d87-4e8e-949e-de7d8d126e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69be15d4-1d87-4e8e-949e-de7d8d126e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-642771599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb2aa709-6629-48ef-99bd-82d44fc878d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f915f256fc75468685c4a9915c05ae45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:19:19Z,use_quota=True,user_id='389a6ea0f64a44c1b8660d56722de984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f704144e-9bdf-4b97-b8b4-956aabf50760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f704144e-9bdf-4b97-b8b4-956aabf50760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fc0a04b-35e9-4068-a2b1-c010570c183e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fc0a04b-35e9-4068-a2b1-c010570c183e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb2aa709-6629-48ef-99bd-82d44fc878d3', 'volume_name': 'volume-bb2aa709-6629-48ef-99bd-82d44fc878d3', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d36647b-f268-470d-88d9-cf07dd0de34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d36647b-f268-470d-88d9-cf07dd0de34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f98b92-4fd0-4a0a-b423-5f4ed71c592c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:19 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] Volume bb2aa709-6629-48ef-99bd-82d44fc878d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb2aa709-6629-48ef-99bd-82d44fc878d3', 'volume_size': 1} Jul 10 18:19:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:19:19 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-22f960e4-1d51-4b86-b7af-7cffe4ad1fda 1073741824" returned: 0 in 1.525s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-22f960e4-1d51-4b86-b7af-7cffe4ad1fda {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:19 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-22f960e4-1d51-4b86-b7af-7cffe4ad1fda Jul 10 18:19:19 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:20 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-22f960e4-1d51-4b86-b7af-7cffe4ad1fda" returned: 0 in 0.847s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:20 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] <== create_volume: return (2420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:19:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.426s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:19:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.059s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:19:20 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1585198218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73f23d45-0657-424b-9f3b-09f2c7099416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f915f256fc75468685c4a9915c05ae45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:19:17Z,use_quota=True,user_id='389a6ea0f64a44c1b8660d56722de984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:19:20 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] Creating volume 73f23d45-0657-424b-9f3b-09f2c7099416 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:19:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:19:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:19:20 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:19:20 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:19:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:19:20 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:19:20 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:19:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73f23d45-0657-424b-9f3b-09f2c7099416 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:20 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73f23d45-0657-424b-9f3b-09f2c7099416 1073741824 Jul 10 18:19:20 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8543326f-01dd-4f90-8274-e8720de4036d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22f960e4-1d51-4b86-b7af-7cffe4ad1fda', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c57c42-ad9c-4f15-84da-1deac3db39d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:20 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] Volume volume-22f960e4-1d51-4b86-b7af-7cffe4ad1fda (22f960e4-1d51-4b86-b7af-7cffe4ad1fda): created successfully Jul 10 18:19:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c57c42-ad9c-4f15-84da-1deac3db39d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] Flow 'volume_create_manager' (802f84bb-cbfe-4309-8770-3e4f37f1d4dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:19:20 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-d7754700-20a5-42f0-99d0-90d6312fdb45 tempest-CreateVolumesFromImageTest-854537523 None] Created volume successfully. Jul 10 18:19:21 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73f23d45-0657-424b-9f3b-09f2c7099416 1073741824" returned: 0 in 1.214s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73f23d45-0657-424b-9f3b-09f2c7099416 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:21 devstack sudo[99924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73f23d45-0657-424b-9f3b-09f2c7099416 Jul 10 18:19:21 devstack sudo[99924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:22 devstack sudo[99924]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73f23d45-0657-424b-9f3b-09f2c7099416" returned: 0 in 0.964s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:22 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] <== create_volume: return (2234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:19:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.239s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:19:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.802s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:19:22 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-437193636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b63c1f7-ffb9-487c-a4a1-4ce3d3e5e8c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f915f256fc75468685c4a9915c05ae45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:19:18Z,use_quota=True,user_id='389a6ea0f64a44c1b8660d56722de984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:19:22 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] Creating volume 8b63c1f7-ffb9-487c-a4a1-4ce3d3e5e8c1 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:19:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:19:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:19:22 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:19:22 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:19:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:19:22 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:19:22 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:19:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8b63c1f7-ffb9-487c-a4a1-4ce3d3e5e8c1 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:22 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2faf0ace-81e5-4fd0-9943-0483dd9f647f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73f23d45-0657-424b-9f3b-09f2c7099416', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:22 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8b63c1f7-ffb9-487c-a4a1-4ce3d3e5e8c1 1073741824 Jul 10 18:19:22 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:22 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8602ebb-b845-4dd1-a60d-83ad5d20b3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:22 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] Volume volume-73f23d45-0657-424b-9f3b-09f2c7099416 (73f23d45-0657-424b-9f3b-09f2c7099416): created successfully Jul 10 18:19:22 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8602ebb-b845-4dd1-a60d-83ad5d20b3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:22 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] Flow 'volume_create_manager' (bcccbd5c-4e2d-4039-bdcc-6220f33d4479) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:19:22 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-782e4dbb-7d8d-44a8-b839-bac0a81e647e tempest-CreateVolumesFromImageTest-854537523 None] Created volume successfully. Jul 10 18:19:23 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8b63c1f7-ffb9-487c-a4a1-4ce3d3e5e8c1 1073741824" returned: 0 in 1.267s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8b63c1f7-ffb9-487c-a4a1-4ce3d3e5e8c1 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:24 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8b63c1f7-ffb9-487c-a4a1-4ce3d3e5e8c1 Jul 10 18:19:24 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:24 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8b63c1f7-ffb9-487c-a4a1-4ce3d3e5e8c1" returned: 0 in 0.848s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] <== create_volume: return (2178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:19:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.184s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:19:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.410s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:19:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1813146125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7649ebc1-3996-45ca-8cde-cdb42e08e5c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f915f256fc75468685c4a9915c05ae45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:19:18Z,use_quota=True,user_id='389a6ea0f64a44c1b8660d56722de984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:19:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] Creating volume 7649ebc1-3996-45ca-8cde-cdb42e08e5c1 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:19:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:19:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:19:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:19:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:19:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:19:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:19:24 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:19:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7649ebc1-3996-45ca-8cde-cdb42e08e5c1 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23090ba5-0ebc-494f-9f7a-96689ba85599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b63c1f7-ffb9-487c-a4a1-4ce3d3e5e8c1', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e391c2e-1cb3-437e-bae9-e6eb8e722659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:24 devstack sudo[99939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7649ebc1-3996-45ca-8cde-cdb42e08e5c1 1073741824 Jul 10 18:19:24 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:24 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] Volume volume-8b63c1f7-ffb9-487c-a4a1-4ce3d3e5e8c1 (8b63c1f7-ffb9-487c-a4a1-4ce3d3e5e8c1): created successfully Jul 10 18:19:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e391c2e-1cb3-437e-bae9-e6eb8e722659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] Flow 'volume_create_manager' (9eb6f440-be64-442f-bcbf-cef74e0ec92a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:19:24 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-477a7153-e585-4d3c-8f5f-e60b881865e9 tempest-CreateVolumesFromImageTest-854537523 None] Created volume successfully. Jul 10 18:19:26 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7649ebc1-3996-45ca-8cde-cdb42e08e5c1 1073741824" returned: 0 in 1.155s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7649ebc1-3996-45ca-8cde-cdb42e08e5c1 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:26 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7649ebc1-3996-45ca-8cde-cdb42e08e5c1 Jul 10 18:19:26 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:26 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7649ebc1-3996-45ca-8cde-cdb42e08e5c1" returned: 0 in 0.699s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:26 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] <== create_volume: return (1903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:19:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.907s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:19:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d920d8d0-d7c1-49fc-840a-c977d77f5c45 tempest-VolumeDependencyTests-1626197307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.647s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:19:26 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0c26667-dbad-4cdc-bd4a-4e4dda521260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7649ebc1-3996-45ca-8cde-cdb42e08e5c1', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:26 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d18446d-69f7-460d-8c7f-3ee978c4c5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:26 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-d920d8d0-d7c1-49fc-840a-c977d77f5c45 tempest-VolumeDependencyTests-1626197307 None] Creating offline snapshot d8dfd381-9690-4371-b138-bac4be1b5b7e of volume a26a6d86-feab-4ab8-a766-5698a2058e4b {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:19:26 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] Volume volume-7649ebc1-3996-45ca-8cde-cdb42e08e5c1 (7649ebc1-3996-45ca-8cde-cdb42e08e5c1): created successfully Jul 10 18:19:26 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d18446d-69f7-460d-8c7f-3ee978c4c5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:26 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] Flow 'volume_create_manager' (e564bb6a-4a59-4ac2-9b50-6d683837f253) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:19:26 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2a3ca3-bcc0-43d9-be0e-cdc317cda534]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:19:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d920d8d0-d7c1-49fc-840a-c977d77f5c45 tempest-VolumeDependencyTests-1626197307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:26 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-279b877f-5930-4eb5-8746-b19a2ab9160f tempest-CreateVolumesFromImageTest-854537523 None] Created volume successfully. Jul 10 18:19:27 devstack sudo[99951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b Jul 10 18:19:27 devstack sudo[99951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:27 devstack sudo[99951]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d920d8d0-d7c1-49fc-840a-c977d77f5c45 tempest-VolumeDependencyTests-1626197307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b" returned: 0 in 0.865s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d920d8d0-d7c1-49fc-840a-c977d77f5c45 tempest-VolumeDependencyTests-1626197307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b.d8dfd381-9690-4371-b138-bac4be1b5b7e 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:27 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b.d8dfd381-9690-4371-b138-bac4be1b5b7e 1G Jul 10 18:19:27 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:28 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d920d8d0-d7c1-49fc-840a-c977d77f5c45 tempest-VolumeDependencyTests-1626197307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b.d8dfd381-9690-4371-b138-bac4be1b5b7e 1G" returned: 0 in 0.923s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d920d8d0-d7c1-49fc-840a-c977d77f5c45 tempest-VolumeDependencyTests-1626197307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a26a6d86-feab-4ab8-a766-5698a2058e4b -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b.d8dfd381-9690-4371-b138-bac4be1b5b7e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:28 devstack sudo[99963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a26a6d86-feab-4ab8-a766-5698a2058e4b -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b.d8dfd381-9690-4371-b138-bac4be1b5b7e Jul 10 18:19:28 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:29 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d920d8d0-d7c1-49fc-840a-c977d77f5c45 tempest-VolumeDependencyTests-1626197307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a26a6d86-feab-4ab8-a766-5698a2058e4b -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b.d8dfd381-9690-4371-b138-bac4be1b5b7e" returned: 0 in 0.926s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:29 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-d920d8d0-d7c1-49fc-840a-c977d77f5c45 tempest-VolumeDependencyTests-1626197307 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b.d8dfd381-9690-4371-b138-bac4be1b5b7e is being set with open permissions: ugo+rw Jul 10 18:19:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d920d8d0-d7c1-49fc-840a-c977d77f5c45 tempest-VolumeDependencyTests-1626197307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b.d8dfd381-9690-4371-b138-bac4be1b5b7e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:29 devstack sudo[99969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b.d8dfd381-9690-4371-b138-bac4be1b5b7e Jul 10 18:19:29 devstack sudo[99969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:30 devstack sudo[99969]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d920d8d0-d7c1-49fc-840a-c977d77f5c45 tempest-VolumeDependencyTests-1626197307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b.d8dfd381-9690-4371-b138-bac4be1b5b7e" returned: 0 in 0.793s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d920d8d0-d7c1-49fc-840a-c977d77f5c45 tempest-VolumeDependencyTests-1626197307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:30 devstack sudo[99973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b.info Jul 10 18:19:30 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:31 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d920d8d0-d7c1-49fc-840a-c977d77f5c45 tempest-VolumeDependencyTests-1626197307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b.info" returned: 0 in 1.047s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:31 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-d920d8d0-d7c1-49fc-840a-c977d77f5c45 tempest-VolumeDependencyTests-1626197307 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b.info is being set with open permissions: ugo+rw Jul 10 18:19:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d920d8d0-d7c1-49fc-840a-c977d77f5c45 tempest-VolumeDependencyTests-1626197307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:31 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b.info Jul 10 18:19:31 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:32 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d920d8d0-d7c1-49fc-840a-c977d77f5c45 tempest-VolumeDependencyTests-1626197307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b.info" returned: 0 in 0.694s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d920d8d0-d7c1-49fc-840a-c977d77f5c45 tempest-VolumeDependencyTests-1626197307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.429s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:19:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.967s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:19:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-642771599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb2aa709-6629-48ef-99bd-82d44fc878d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f915f256fc75468685c4a9915c05ae45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:19:19Z,use_quota=True,user_id='389a6ea0f64a44c1b8660d56722de984',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:19:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] Creating volume bb2aa709-6629-48ef-99bd-82d44fc878d3 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:19:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:19:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:19:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:19:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:19:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:19:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:19:32 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:19:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bb2aa709-6629-48ef-99bd-82d44fc878d3 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:32 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bb2aa709-6629-48ef-99bd-82d44fc878d3 1073741824 Jul 10 18:19:32 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:32 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-d920d8d0-d7c1-49fc-840a-c977d77f5c45 tempest-VolumeDependencyTests-1626197307 None] Create snapshot completed successfully Jul 10 18:19:33 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bb2aa709-6629-48ef-99bd-82d44fc878d3 1073741824" returned: 0 in 0.957s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bb2aa709-6629-48ef-99bd-82d44fc878d3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:33 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bb2aa709-6629-48ef-99bd-82d44fc878d3 Jul 10 18:19:33 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:33 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:19:33 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Flow 'volume_create_manager' (8303b251-ca20-479c-bc0d-8b65644163f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:19:33 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9213f1e7-aa9c-43c6-b227-94a6209ab5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:33 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9213f1e7-aa9c-43c6-b227-94a6209ab5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-235641836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a414b780-b82d-4825-b935-22adaac89692,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df208950d0de4e5c93eb90d9e3dacfb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d8dfd381-9690-4371-b138-bac4be1b5b7e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:19:33Z,use_quota=True,user_id='4bcc2cca0f8940e4b61abc91cec021a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:33 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (440e1b55-bc9d-43cd-9352-74ea2520904c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:33 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (440e1b55-bc9d-43cd-9352-74ea2520904c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:33 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4165fe73-1610-4406-85be-b6447b65e8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:33 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4165fe73-1610-4406-85be-b6447b65e8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a414b780-b82d-4825-b935-22adaac89692', 'volume_name': 'volume-a414b780-b82d-4825-b935-22adaac89692', 'volume_size': 1, 'snapshot_id': 'd8dfd381-9690-4371-b138-bac4be1b5b7e'}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:33 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05877cdd-2607-4de1-b9b4-b02acee396ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:33 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05877cdd-2607-4de1-b9b4-b02acee396ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:33 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a31fe6a4-f2a1-4e72-b017-db1a2f9e19eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:33 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Volume a414b780-b82d-4825-b935-22adaac89692: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a414b780-b82d-4825-b935-22adaac89692', 'volume_size': 1, 'snapshot_id': 'd8dfd381-9690-4371-b138-bac4be1b5b7e'} Jul 10 18:19:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:19:34 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bb2aa709-6629-48ef-99bd-82d44fc878d3" returned: 0 in 0.852s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:34 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] <== create_volume: return (1867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:19:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.871s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:19:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.396s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:19:34 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Acquiring lock "cinder-quobyte-d8dfd381-9690-4371-b138-bac4be1b5b7e-a414b780-b82d-4825-b935-22adaac89692" by "_create_volume_from_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:19:34 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4f98b92-4fd0-4a0a-b423-5f4ed71c592c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb2aa709-6629-48ef-99bd-82d44fc878d3', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:34 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae22ba2-552f-47a7-8cb8-a520a4d2c75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:34 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Lock "cinder-quobyte-d8dfd381-9690-4371-b138-bac4be1b5b7e-a414b780-b82d-4825-b935-22adaac89692" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:19:34 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Creating volume a414b780-b82d-4825-b935-22adaac89692 from snapshot d8dfd381-9690-4371-b138-bac4be1b5b7e {{(pid=87399) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 18:19:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:19:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:19:34 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:19:34 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:19:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:19:34 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:19:34 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Acquiring lock "cinder-quobyte-a414b780-b82d-4825-b935-22adaac89692" by "_copy_volume_from_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:19:34 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] Volume volume-bb2aa709-6629-48ef-99bd-82d44fc878d3 (bb2aa709-6629-48ef-99bd-82d44fc878d3): created successfully Jul 10 18:19:34 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae22ba2-552f-47a7-8cb8-a520a4d2c75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:34 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] Flow 'volume_create_manager' (78e8dbc6-a54b-4316-a2c1-e626928e4896) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:19:34 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Lock "cinder-quobyte-a414b780-b82d-4825-b935-22adaac89692" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:19:34 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] snapshot: d8dfd381-9690-4371-b138-bac4be1b5b7e, volume: a414b780-b82d-4825-b935-22adaac89692, {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 18:19:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:19:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:19:34 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:19:34 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:19:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:19:34 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-d699445b-aa4b-4191-9eb9-313ed433b55a tempest-CreateVolumesFromImageTest-854537523 None] Created volume successfully. Jul 10 18:19:34 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[587db4d6-5c9e-4c90-a0fb-252a29960307]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:19:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b.d8dfd381-9690-4371-b138-bac4be1b5b7e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:34 devstack sudo[100007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b.d8dfd381-9690-4371-b138-bac4be1b5b7e Jul 10 18:19:34 devstack sudo[100007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:34 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e1718efe-fc3f-4713-8db7-0b33f6019c02 tempest-CreateVolumesFromImageTest-854537523 None] Acquiring lock "cinder-bb2aa709-6629-48ef-99bd-82d44fc878d3-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:19:34 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e1718efe-fc3f-4713-8db7-0b33f6019c02 tempest-CreateVolumesFromImageTest-854537523 None] Lock "cinder-bb2aa709-6629-48ef-99bd-82d44fc878d3-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:19:35 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e1718efe-fc3f-4713-8db7-0b33f6019c02 tempest-CreateVolumesFromImageTest-854537523 None] Acquiring lock "cinder-quobyte-bb2aa709-6629-48ef-99bd-82d44fc878d3" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:19:35 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e1718efe-fc3f-4713-8db7-0b33f6019c02 tempest-CreateVolumesFromImageTest-854537523 None] Lock "cinder-quobyte-bb2aa709-6629-48ef-99bd-82d44fc878d3" acquired by "delete_volume" :: waited 0.032s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:19:35 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af8b329-3f04-43b1-8875-fcdf84c0b2d5]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:19:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e1718efe-fc3f-4713-8db7-0b33f6019c02 tempest-CreateVolumesFromImageTest-854537523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bb2aa709-6629-48ef-99bd-82d44fc878d3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:35 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bb2aa709-6629-48ef-99bd-82d44fc878d3 Jul 10 18:19:35 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:35 devstack sudo[100007]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b.d8dfd381-9690-4371-b138-bac4be1b5b7e" returned: 0 in 1.547s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a26a6d86-feab-4ab8-a766-5698a2058e4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:19:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] will copy from snapshot at /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 18:19:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Creating direct copy from snapshot {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 18:19:35 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc1d6d6-a233-41a2-ae46-5aca37f19df2]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:19:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:35 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b Jul 10 18:19:35 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:36 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e1718efe-fc3f-4713-8db7-0b33f6019c02 tempest-CreateVolumesFromImageTest-854537523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bb2aa709-6629-48ef-99bd-82d44fc878d3" returned: 0 in 1.208s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e1718efe-fc3f-4713-8db7-0b33f6019c02 tempest-CreateVolumesFromImageTest-854537523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bb2aa709-6629-48ef-99bd-82d44fc878d3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:36 devstack sudo[100181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bb2aa709-6629-48ef-99bd-82d44fc878d3 Jul 10 18:19:36 devstack sudo[100181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:36 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b" returned: 0 in 1.064s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:36 devstack cinder-volume[87399]: DEBUG cinder.utils [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Path /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a414b780-b82d-4825-b935-22adaac89692 not found in is_blk_device check {{(pid=87399) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 18:19:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a414b780-b82d-4825-b935-22adaac89692 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:36 devstack sudo[100186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a414b780-b82d-4825-b935-22adaac89692 Jul 10 18:19:36 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:37 devstack sudo[100181]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e1718efe-fc3f-4713-8db7-0b33f6019c02 tempest-CreateVolumesFromImageTest-854537523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bb2aa709-6629-48ef-99bd-82d44fc878d3" returned: 0 in 0.831s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:37 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e1718efe-fc3f-4713-8db7-0b33f6019c02 tempest-CreateVolumesFromImageTest-854537523 None] Lock "cinder-quobyte-bb2aa709-6629-48ef-99bd-82d44fc878d3" released by "delete_volume" :: held 2.126s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:19:37 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-e1718efe-fc3f-4713-8db7-0b33f6019c02 tempest-CreateVolumesFromImageTest-854537523 None] Created reservations ['afec5002-c9e9-479e-93b6-8bde51f386b8', 'c7b63675-9ce8-459a-a7ec-8e4199139a7d', '4dac4e1b-9157-4d83-ab69-e9b0babaf445', 'a02f8d21-c4bd-4941-958c-2386af152956'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:19:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e1718efe-fc3f-4713-8db7-0b33f6019c02 tempest-CreateVolumesFromImageTest-854537523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:19:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e1718efe-fc3f-4713-8db7-0b33f6019c02 tempest-CreateVolumesFromImageTest-854537523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:19:37 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e1718efe-fc3f-4713-8db7-0b33f6019c02 tempest-CreateVolumesFromImageTest-854537523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:19:37 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e1718efe-fc3f-4713-8db7-0b33f6019c02 tempest-CreateVolumesFromImageTest-854537523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:19:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e1718efe-fc3f-4713-8db7-0b33f6019c02 tempest-CreateVolumesFromImageTest-854537523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:19:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e1718efe-fc3f-4713-8db7-0b33f6019c02 tempest-CreateVolumesFromImageTest-854537523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:37 devstack sudo[100191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:19:37 devstack sudo[100191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:38 devstack sudo[100191]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e1718efe-fc3f-4713-8db7-0b33f6019c02 tempest-CreateVolumesFromImageTest-854537523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.394s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:38 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-e1718efe-fc3f-4713-8db7-0b33f6019c02 tempest-CreateVolumesFromImageTest-854537523 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:19:38 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ec65696c-e350-4a71-966d-5231f6114545 tempest-CreateVolumesFromImageTest-854537523 None] Acquiring lock "cinder-7649ebc1-3996-45ca-8cde-cdb42e08e5c1-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:19:38 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-e1718efe-fc3f-4713-8db7-0b33f6019c02 tempest-CreateVolumesFromImageTest-854537523 None] Deleted volume successfully. Jul 10 18:19:38 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ec65696c-e350-4a71-966d-5231f6114545 tempest-CreateVolumesFromImageTest-854537523 None] Lock "cinder-7649ebc1-3996-45ca-8cde-cdb42e08e5c1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:19:38 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e1718efe-fc3f-4713-8db7-0b33f6019c02 tempest-CreateVolumesFromImageTest-854537523 None] Lock "cinder-bb2aa709-6629-48ef-99bd-82d44fc878d3-delete_volume" released by "delete_volume" :: held 3.922s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:19:38 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ec65696c-e350-4a71-966d-5231f6114545 tempest-CreateVolumesFromImageTest-854537523 None] Acquiring lock "cinder-quobyte-7649ebc1-3996-45ca-8cde-cdb42e08e5c1" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:19:38 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ec65696c-e350-4a71-966d-5231f6114545 tempest-CreateVolumesFromImageTest-854537523 None] Lock "cinder-quobyte-7649ebc1-3996-45ca-8cde-cdb42e08e5c1" acquired by "delete_volume" :: waited 0.043s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:19:39 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e7abb2-f90b-4c5e-b7ee-7a79b6ac958d]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:19:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ec65696c-e350-4a71-966d-5231f6114545 tempest-CreateVolumesFromImageTest-854537523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7649ebc1-3996-45ca-8cde-cdb42e08e5c1 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:39 devstack sudo[100205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7649ebc1-3996-45ca-8cde-cdb42e08e5c1 Jul 10 18:19:39 devstack sudo[100205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:41 devstack sudo[100205]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ec65696c-e350-4a71-966d-5231f6114545 tempest-CreateVolumesFromImageTest-854537523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7649ebc1-3996-45ca-8cde-cdb42e08e5c1" returned: 0 in 2.053s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ec65696c-e350-4a71-966d-5231f6114545 tempest-CreateVolumesFromImageTest-854537523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7649ebc1-3996-45ca-8cde-cdb42e08e5c1 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:41 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7649ebc1-3996-45ca-8cde-cdb42e08e5c1 Jul 10 18:19:41 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:43 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ec65696c-e350-4a71-966d-5231f6114545 tempest-CreateVolumesFromImageTest-854537523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7649ebc1-3996-45ca-8cde-cdb42e08e5c1" returned: 0 in 2.858s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:44 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ec65696c-e350-4a71-966d-5231f6114545 tempest-CreateVolumesFromImageTest-854537523 None] Lock "cinder-quobyte-7649ebc1-3996-45ca-8cde-cdb42e08e5c1" released by "delete_volume" :: held 5.070s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:19:44 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-ec65696c-e350-4a71-966d-5231f6114545 tempest-CreateVolumesFromImageTest-854537523 None] Created reservations ['34300224-79c0-49a8-87be-cd44cac80247', 'ccb82782-15bc-41d2-936f-fc117d48b874', '9143d653-fe41-47f4-b1ad-7d50ab381e2a', '3463e0f0-d853-4dc2-af9d-6949697fee5f'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:19:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ec65696c-e350-4a71-966d-5231f6114545 tempest-CreateVolumesFromImageTest-854537523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:19:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ec65696c-e350-4a71-966d-5231f6114545 tempest-CreateVolumesFromImageTest-854537523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:19:44 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ec65696c-e350-4a71-966d-5231f6114545 tempest-CreateVolumesFromImageTest-854537523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:19:44 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ec65696c-e350-4a71-966d-5231f6114545 tempest-CreateVolumesFromImageTest-854537523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:19:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ec65696c-e350-4a71-966d-5231f6114545 tempest-CreateVolumesFromImageTest-854537523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:19:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ec65696c-e350-4a71-966d-5231f6114545 tempest-CreateVolumesFromImageTest-854537523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:44 devstack sudo[100214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:19:44 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a414b780-b82d-4825-b935-22adaac89692" returned: 0 in 8.120s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:45 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cbb58d-202c-4255-8151-d4b644a3c6ea]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:19:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:45 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-498bd2de-b0d7-4a0a-adc1-25f56dea1fac tempest-CreateVolumesFromImageTest-854537523 None] Acquiring lock "cinder-8b63c1f7-ffb9-487c-a4a1-4ce3d3e5e8c1-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:19:45 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b Jul 10 18:19:45 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:45 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-498bd2de-b0d7-4a0a-adc1-25f56dea1fac tempest-CreateVolumesFromImageTest-854537523 None] Lock "cinder-8b63c1f7-ffb9-487c-a4a1-4ce3d3e5e8c1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:19:45 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-498bd2de-b0d7-4a0a-adc1-25f56dea1fac tempest-CreateVolumesFromImageTest-854537523 None] Acquiring lock "cinder-quobyte-8b63c1f7-ffb9-487c-a4a1-4ce3d3e5e8c1" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:19:45 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-498bd2de-b0d7-4a0a-adc1-25f56dea1fac tempest-CreateVolumesFromImageTest-854537523 None] Lock "cinder-quobyte-8b63c1f7-ffb9-487c-a4a1-4ce3d3e5e8c1" acquired by "delete_volume" :: waited 0.049s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:19:45 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1d25de-5bd8-4982-804d-024c5e27e952]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:19:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-498bd2de-b0d7-4a0a-adc1-25f56dea1fac tempest-CreateVolumesFromImageTest-854537523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8b63c1f7-ffb9-487c-a4a1-4ce3d3e5e8c1 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:45 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8b63c1f7-ffb9-487c-a4a1-4ce3d3e5e8c1 Jul 10 18:19:45 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:46 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ec65696c-e350-4a71-966d-5231f6114545 tempest-CreateVolumesFromImageTest-854537523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.858s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:46 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-ec65696c-e350-4a71-966d-5231f6114545 tempest-CreateVolumesFromImageTest-854537523 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:19:46 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-ec65696c-e350-4a71-966d-5231f6114545 tempest-CreateVolumesFromImageTest-854537523 None] Deleted volume successfully. Jul 10 18:19:46 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ec65696c-e350-4a71-966d-5231f6114545 tempest-CreateVolumesFromImageTest-854537523 None] Lock "cinder-7649ebc1-3996-45ca-8cde-cdb42e08e5c1-delete_volume" released by "delete_volume" :: held 7.499s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:19:46 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b" returned: 0 in 1.783s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:46 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Image conversion details: src /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b, size 1024.00 MB, duration 8.12 sec, destination /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a414b780-b82d-4825-b935-22adaac89692 {{(pid=87399) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 18:19:46 devstack cinder-volume[87399]: INFO cinder.image.image_utils [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Converted 1024.00 MB image at 126.05 MB/s Jul 10 18:19:46 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a414b780-b82d-4825-b935-22adaac89692 is being set with open permissions: ugo+rw Jul 10 18:19:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a414b780-b82d-4825-b935-22adaac89692 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:46 devstack sudo[100265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a414b780-b82d-4825-b935-22adaac89692 Jul 10 18:19:46 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:47 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-498bd2de-b0d7-4a0a-adc1-25f56dea1fac tempest-CreateVolumesFromImageTest-854537523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8b63c1f7-ffb9-487c-a4a1-4ce3d3e5e8c1" returned: 0 in 1.448s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-498bd2de-b0d7-4a0a-adc1-25f56dea1fac tempest-CreateVolumesFromImageTest-854537523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8b63c1f7-ffb9-487c-a4a1-4ce3d3e5e8c1 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:47 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8b63c1f7-ffb9-487c-a4a1-4ce3d3e5e8c1 Jul 10 18:19:47 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:47 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a414b780-b82d-4825-b935-22adaac89692" returned: 0 in 1.049s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:47 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Lock "cinder-quobyte-a414b780-b82d-4825-b935-22adaac89692" released by "_copy_volume_from_snapshot" :: held 13.724s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:19:47 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Lock "cinder-quobyte-d8dfd381-9690-4371-b138-bac4be1b5b7e-a414b780-b82d-4825-b935-22adaac89692" released by "_create_volume_from_snapshot" :: held 13.771s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:19:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.809s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:19:47 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a31fe6a4-f2a1-4e72-b017-db1a2f9e19eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a414b780-b82d-4825-b935-22adaac89692', 'volume_size': 1, 'snapshot_id': 'd8dfd381-9690-4371-b138-bac4be1b5b7e'}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:47 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9a0821e-4d86-4607-b649-33051426efba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:48 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Volume volume-a414b780-b82d-4825-b935-22adaac89692 (a414b780-b82d-4825-b935-22adaac89692): created successfully Jul 10 18:19:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9a0821e-4d86-4607-b649-33051426efba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Flow 'volume_create_manager' (8303b251-ca20-479c-bc0d-8b65644163f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:19:48 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-a568fbdd-9e9b-4e6c-844b-adcde6ae8d86 tempest-VolumeDependencyTests-1626197307 None] Created volume successfully. Jul 10 18:19:48 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-498bd2de-b0d7-4a0a-adc1-25f56dea1fac tempest-CreateVolumesFromImageTest-854537523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8b63c1f7-ffb9-487c-a4a1-4ce3d3e5e8c1" returned: 0 in 0.939s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-498bd2de-b0d7-4a0a-adc1-25f56dea1fac tempest-CreateVolumesFromImageTest-854537523 None] Lock "cinder-quobyte-8b63c1f7-ffb9-487c-a4a1-4ce3d3e5e8c1" released by "delete_volume" :: held 2.455s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:19:48 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-498bd2de-b0d7-4a0a-adc1-25f56dea1fac tempest-CreateVolumesFromImageTest-854537523 None] Created reservations ['f0f6dccb-710f-476c-9816-b00c3df5db49', 'cffeb624-54d9-474e-8091-836cdfd47a96', '5e8f56aa-6ee5-4dce-b6b1-521392f64fd1', '863ada1e-6f1c-4e03-b351-bf746beeb1b4'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:19:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-498bd2de-b0d7-4a0a-adc1-25f56dea1fac tempest-CreateVolumesFromImageTest-854537523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:19:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-498bd2de-b0d7-4a0a-adc1-25f56dea1fac tempest-CreateVolumesFromImageTest-854537523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:19:48 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-498bd2de-b0d7-4a0a-adc1-25f56dea1fac tempest-CreateVolumesFromImageTest-854537523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:19:48 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-498bd2de-b0d7-4a0a-adc1-25f56dea1fac tempest-CreateVolumesFromImageTest-854537523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:19:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-498bd2de-b0d7-4a0a-adc1-25f56dea1fac tempest-CreateVolumesFromImageTest-854537523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:19:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-498bd2de-b0d7-4a0a-adc1-25f56dea1fac tempest-CreateVolumesFromImageTest-854537523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:48 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:19:48 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3b4aa055-525c-4ec9-9203-f25b48d94230 tempest-VolumeDependencyTests-1626197307 None] Acquiring lock "cinder-d8dfd381-9690-4371-b138-bac4be1b5b7e-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:19:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3b4aa055-525c-4ec9-9203-f25b48d94230 tempest-VolumeDependencyTests-1626197307 None] Lock "cinder-d8dfd381-9690-4371-b138-bac4be1b5b7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:19:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3b4aa055-525c-4ec9-9203-f25b48d94230 tempest-VolumeDependencyTests-1626197307 None] Acquiring lock "cinder-quobyte-a26a6d86-feab-4ab8-a766-5698a2058e4b" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:19:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3b4aa055-525c-4ec9-9203-f25b48d94230 tempest-VolumeDependencyTests-1626197307 None] Lock "cinder-quobyte-a26a6d86-feab-4ab8-a766-5698a2058e4b" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:19:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3b4aa055-525c-4ec9-9203-f25b48d94230 tempest-VolumeDependencyTests-1626197307 None] Acquiring lock "cinder-quobyte-d8dfd381-9690-4371-b138-bac4be1b5b7e" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:19:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3b4aa055-525c-4ec9-9203-f25b48d94230 tempest-VolumeDependencyTests-1626197307 None] Lock "cinder-quobyte-d8dfd381-9690-4371-b138-bac4be1b5b7e" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:19:48 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-3b4aa055-525c-4ec9-9203-f25b48d94230 tempest-VolumeDependencyTests-1626197307 None] Deleting offline snapshot d8dfd381-9690-4371-b138-bac4be1b5b7e of volume a26a6d86-feab-4ab8-a766-5698a2058e4b {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:19:48 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-3b4aa055-525c-4ec9-9203-f25b48d94230 tempest-VolumeDependencyTests-1626197307 None] snapshot_file for this snap is: volume-a26a6d86-feab-4ab8-a766-5698a2058e4b.d8dfd381-9690-4371-b138-bac4be1b5b7e {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:19:48 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b043242-30da-4d8a-9370-f736a77b49d7]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:19:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3b4aa055-525c-4ec9-9203-f25b48d94230 tempest-VolumeDependencyTests-1626197307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b.d8dfd381-9690-4371-b138-bac4be1b5b7e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:48 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b.d8dfd381-9690-4371-b138-bac4be1b5b7e Jul 10 18:19:48 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1c5193a5-63bf-4aa0-844c-7b473c227c2e tempest-CreateVolumesFromImageTest-854537523 None] Acquiring lock "cinder-73f23d45-0657-424b-9f3b-09f2c7099416-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:19:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1c5193a5-63bf-4aa0-844c-7b473c227c2e tempest-CreateVolumesFromImageTest-854537523 None] Lock "cinder-73f23d45-0657-424b-9f3b-09f2c7099416-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:19:48 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-498bd2de-b0d7-4a0a-adc1-25f56dea1fac tempest-CreateVolumesFromImageTest-854537523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.785s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:48 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-498bd2de-b0d7-4a0a-adc1-25f56dea1fac tempest-CreateVolumesFromImageTest-854537523 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:19:49 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-498bd2de-b0d7-4a0a-adc1-25f56dea1fac tempest-CreateVolumesFromImageTest-854537523 None] Deleted volume successfully. Jul 10 18:19:49 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1c5193a5-63bf-4aa0-844c-7b473c227c2e tempest-CreateVolumesFromImageTest-854537523 None] Acquiring lock "cinder-quobyte-73f23d45-0657-424b-9f3b-09f2c7099416" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:19:49 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-498bd2de-b0d7-4a0a-adc1-25f56dea1fac tempest-CreateVolumesFromImageTest-854537523 None] Lock "cinder-8b63c1f7-ffb9-487c-a4a1-4ce3d3e5e8c1-delete_volume" released by "delete_volume" :: held 3.720s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:19:49 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1c5193a5-63bf-4aa0-844c-7b473c227c2e tempest-CreateVolumesFromImageTest-854537523 None] Lock "cinder-quobyte-73f23d45-0657-424b-9f3b-09f2c7099416" acquired by "delete_volume" :: waited 0.036s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:19:49 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[c773516f-ded2-4104-a7ef-c354a4792ebc]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:19:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1c5193a5-63bf-4aa0-844c-7b473c227c2e tempest-CreateVolumesFromImageTest-854537523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73f23d45-0657-424b-9f3b-09f2c7099416 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:49 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73f23d45-0657-424b-9f3b-09f2c7099416 Jul 10 18:19:49 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:49 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3b4aa055-525c-4ec9-9203-f25b48d94230 tempest-VolumeDependencyTests-1626197307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b.d8dfd381-9690-4371-b138-bac4be1b5b7e" returned: 0 in 1.025s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:49 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-3b4aa055-525c-4ec9-9203-f25b48d94230 tempest-VolumeDependencyTests-1626197307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a26a6d86-feab-4ab8-a766-5698a2058e4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:19:49 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd116b68-a4ff-4263-9ace-1812c42f9a4c]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:19:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3b4aa055-525c-4ec9-9203-f25b48d94230 tempest-VolumeDependencyTests-1626197307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:49 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b Jul 10 18:19:49 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:50 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1c5193a5-63bf-4aa0-844c-7b473c227c2e tempest-CreateVolumesFromImageTest-854537523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73f23d45-0657-424b-9f3b-09f2c7099416" returned: 0 in 0.860s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1c5193a5-63bf-4aa0-844c-7b473c227c2e tempest-CreateVolumesFromImageTest-854537523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73f23d45-0657-424b-9f3b-09f2c7099416 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:50 devstack sudo[100306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73f23d45-0657-424b-9f3b-09f2c7099416 Jul 10 18:19:50 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:50 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3b4aa055-525c-4ec9-9203-f25b48d94230 tempest-VolumeDependencyTests-1626197307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b" returned: 0 in 0.813s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3b4aa055-525c-4ec9-9203-f25b48d94230 tempest-VolumeDependencyTests-1626197307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b.d8dfd381-9690-4371-b138-bac4be1b5b7e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:50 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b.d8dfd381-9690-4371-b138-bac4be1b5b7e Jul 10 18:19:50 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:50 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1c5193a5-63bf-4aa0-844c-7b473c227c2e tempest-CreateVolumesFromImageTest-854537523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-73f23d45-0657-424b-9f3b-09f2c7099416" returned: 0 in 0.714s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:50 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1c5193a5-63bf-4aa0-844c-7b473c227c2e tempest-CreateVolumesFromImageTest-854537523 None] Lock "cinder-quobyte-73f23d45-0657-424b-9f3b-09f2c7099416" released by "delete_volume" :: held 1.635s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:19:50 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-1c5193a5-63bf-4aa0-844c-7b473c227c2e tempest-CreateVolumesFromImageTest-854537523 None] Created reservations ['283891ba-e063-4609-a493-d16ac1623590', '23044dd3-34d3-4bcc-8cf3-38a7d3f14d26', 'dbe1f6fa-6dc9-4ada-917e-58900edf31cc', '6227e8f2-8b44-4e82-8703-921bb6192b1f'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:19:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1c5193a5-63bf-4aa0-844c-7b473c227c2e tempest-CreateVolumesFromImageTest-854537523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:19:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1c5193a5-63bf-4aa0-844c-7b473c227c2e tempest-CreateVolumesFromImageTest-854537523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:19:50 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1c5193a5-63bf-4aa0-844c-7b473c227c2e tempest-CreateVolumesFromImageTest-854537523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:19:50 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1c5193a5-63bf-4aa0-844c-7b473c227c2e tempest-CreateVolumesFromImageTest-854537523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:19:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1c5193a5-63bf-4aa0-844c-7b473c227c2e tempest-CreateVolumesFromImageTest-854537523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:19:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1c5193a5-63bf-4aa0-844c-7b473c227c2e tempest-CreateVolumesFromImageTest-854537523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:50 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:19:50 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:51 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-269efdab-7112-4835-b6b6-e8ad79db0f51 tempest-CreateVolumesFromImageTest-854537523 None] Acquiring lock "cinder-22f960e4-1d51-4b86-b7af-7cffe4ad1fda-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:19:51 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-269efdab-7112-4835-b6b6-e8ad79db0f51 tempest-CreateVolumesFromImageTest-854537523 None] Lock "cinder-22f960e4-1d51-4b86-b7af-7cffe4ad1fda-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:19:51 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-269efdab-7112-4835-b6b6-e8ad79db0f51 tempest-CreateVolumesFromImageTest-854537523 None] Acquiring lock "cinder-quobyte-22f960e4-1d51-4b86-b7af-7cffe4ad1fda" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:19:51 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-269efdab-7112-4835-b6b6-e8ad79db0f51 tempest-CreateVolumesFromImageTest-854537523 None] Lock "cinder-quobyte-22f960e4-1d51-4b86-b7af-7cffe4ad1fda" acquired by "delete_volume" :: waited 0.019s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:19:51 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbb727f-8d28-4e22-a5c9-5f3e0a03327c]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:19:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-269efdab-7112-4835-b6b6-e8ad79db0f51 tempest-CreateVolumesFromImageTest-854537523 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-22f960e4-1d51-4b86-b7af-7cffe4ad1fda {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:51 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3b4aa055-525c-4ec9-9203-f25b48d94230 tempest-VolumeDependencyTests-1626197307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b.d8dfd381-9690-4371-b138-bac4be1b5b7e" returned: 0 in 0.842s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3b4aa055-525c-4ec9-9203-f25b48d94230 tempest-VolumeDependencyTests-1626197307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b.d8dfd381-9690-4371-b138-bac4be1b5b7e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:51 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b.d8dfd381-9690-4371-b138-bac4be1b5b7e Jul 10 18:19:51 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:51 devstack sudo[100324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-22f960e4-1d51-4b86-b7af-7cffe4ad1fda Jul 10 18:19:51 devstack sudo[100324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:51 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1c5193a5-63bf-4aa0-844c-7b473c227c2e tempest-CreateVolumesFromImageTest-854537523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.678s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:51 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-1c5193a5-63bf-4aa0-844c-7b473c227c2e tempest-CreateVolumesFromImageTest-854537523 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:19:51 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-1c5193a5-63bf-4aa0-844c-7b473c227c2e tempest-CreateVolumesFromImageTest-854537523 None] Deleted volume successfully. Jul 10 18:19:51 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1c5193a5-63bf-4aa0-844c-7b473c227c2e tempest-CreateVolumesFromImageTest-854537523 None] Lock "cinder-73f23d45-0657-424b-9f3b-09f2c7099416-delete_volume" released by "delete_volume" :: held 2.644s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:19:52 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3b4aa055-525c-4ec9-9203-f25b48d94230 tempest-VolumeDependencyTests-1626197307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b.d8dfd381-9690-4371-b138-bac4be1b5b7e" returned: 0 in 0.722s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:52 devstack sudo[100324]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-269efdab-7112-4835-b6b6-e8ad79db0f51 tempest-CreateVolumesFromImageTest-854537523 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-22f960e4-1d51-4b86-b7af-7cffe4ad1fda" returned: 0 in 0.808s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-269efdab-7112-4835-b6b6-e8ad79db0f51 tempest-CreateVolumesFromImageTest-854537523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-22f960e4-1d51-4b86-b7af-7cffe4ad1fda {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:52 devstack sudo[100333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-22f960e4-1d51-4b86-b7af-7cffe4ad1fda Jul 10 18:19:52 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3b4aa055-525c-4ec9-9203-f25b48d94230 tempest-VolumeDependencyTests-1626197307 None] Lock "cinder-quobyte-d8dfd381-9690-4371-b138-bac4be1b5b7e" released by "_delete_snapshot" :: held 3.536s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:19:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3b4aa055-525c-4ec9-9203-f25b48d94230 tempest-VolumeDependencyTests-1626197307 None] Lock "cinder-quobyte-a26a6d86-feab-4ab8-a766-5698a2058e4b" released by "delete_snapshot" :: held 3.567s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:19:52 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-3b4aa055-525c-4ec9-9203-f25b48d94230 tempest-VolumeDependencyTests-1626197307 None] Created reservations ['19ebe023-6b11-41b8-b14f-4797c8bfe9a5', '06db0a41-f9f8-4641-8cca-545020ed7b0f', '89003bf8-7532-4992-92de-e5b3c6342777', '1ebced16-4de2-4db4-97cf-d4ad0a08ab2d'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:19:52 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-3b4aa055-525c-4ec9-9203-f25b48d94230 tempest-VolumeDependencyTests-1626197307 None] Delete snapshot completed successfully. Jul 10 18:19:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3b4aa055-525c-4ec9-9203-f25b48d94230 tempest-VolumeDependencyTests-1626197307 None] Lock "cinder-d8dfd381-9690-4371-b138-bac4be1b5b7e-delete_snapshot" released by "delete_snapshot" :: held 3.738s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:19:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4823a01f-a3aa-4190-a62f-c4bd990e3251 tempest-VolumeDependencyTests-1626197307 None] Acquiring lock "cinder-a26a6d86-feab-4ab8-a766-5698a2058e4b-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:19:52 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4823a01f-a3aa-4190-a62f-c4bd990e3251 tempest-VolumeDependencyTests-1626197307 None] Lock "cinder-a26a6d86-feab-4ab8-a766-5698a2058e4b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:19:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-269efdab-7112-4835-b6b6-e8ad79db0f51 tempest-CreateVolumesFromImageTest-854537523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-22f960e4-1d51-4b86-b7af-7cffe4ad1fda" returned: 0 in 0.701s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-269efdab-7112-4835-b6b6-e8ad79db0f51 tempest-CreateVolumesFromImageTest-854537523 None] Lock "cinder-quobyte-22f960e4-1d51-4b86-b7af-7cffe4ad1fda" released by "delete_volume" :: held 1.561s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:19:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4823a01f-a3aa-4190-a62f-c4bd990e3251 tempest-VolumeDependencyTests-1626197307 None] Acquiring lock "cinder-quobyte-a26a6d86-feab-4ab8-a766-5698a2058e4b" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:19:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4823a01f-a3aa-4190-a62f-c4bd990e3251 tempest-VolumeDependencyTests-1626197307 None] Lock "cinder-quobyte-a26a6d86-feab-4ab8-a766-5698a2058e4b" acquired by "delete_volume" :: waited 0.025s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:19:52 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd3b97c-9e80-4613-9c28-a7c74ad98ebe]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:19:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4823a01f-a3aa-4190-a62f-c4bd990e3251 tempest-VolumeDependencyTests-1626197307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:52 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-269efdab-7112-4835-b6b6-e8ad79db0f51 tempest-CreateVolumesFromImageTest-854537523 None] Created reservations ['8d60a414-1395-439e-9869-a37670c4ae53', '2242ead5-2b27-40f4-9629-00efb1260f5d', 'b2e42ca4-1930-44c6-b7ba-a907a89a6b8f', 'ba96f970-4a0c-4c14-8706-5aaf5764180d'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:19:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-269efdab-7112-4835-b6b6-e8ad79db0f51 tempest-CreateVolumesFromImageTest-854537523 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:19:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-269efdab-7112-4835-b6b6-e8ad79db0f51 tempest-CreateVolumesFromImageTest-854537523 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:19:53 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-269efdab-7112-4835-b6b6-e8ad79db0f51 tempest-CreateVolumesFromImageTest-854537523 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:19:53 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-269efdab-7112-4835-b6b6-e8ad79db0f51 tempest-CreateVolumesFromImageTest-854537523 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:19:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-269efdab-7112-4835-b6b6-e8ad79db0f51 tempest-CreateVolumesFromImageTest-854537523 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:19:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-269efdab-7112-4835-b6b6-e8ad79db0f51 tempest-CreateVolumesFromImageTest-854537523 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:53 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b Jul 10 18:19:53 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:53 devstack sudo[100339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:19:53 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:53 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4823a01f-a3aa-4190-a62f-c4bd990e3251 tempest-VolumeDependencyTests-1626197307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b" returned: 0 in 0.882s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4823a01f-a3aa-4190-a62f-c4bd990e3251 tempest-VolumeDependencyTests-1626197307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:53 devstack sudo[100349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b Jul 10 18:19:53 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:53 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-269efdab-7112-4835-b6b6-e8ad79db0f51 tempest-CreateVolumesFromImageTest-854537523 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.866s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:53 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-269efdab-7112-4835-b6b6-e8ad79db0f51 tempest-CreateVolumesFromImageTest-854537523 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:19:53 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-269efdab-7112-4835-b6b6-e8ad79db0f51 tempest-CreateVolumesFromImageTest-854537523 None] Deleted volume successfully. Jul 10 18:19:53 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=74,cinder:INSERT=27,cinder:UPDATE=99,cinder:DELETE=6 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:19:53 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-269efdab-7112-4835-b6b6-e8ad79db0f51 tempest-CreateVolumesFromImageTest-854537523 None] Lock "cinder-22f960e4-1d51-4b86-b7af-7cffe4ad1fda-delete_volume" released by "delete_volume" :: held 2.779s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:19:54 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4823a01f-a3aa-4190-a62f-c4bd990e3251 tempest-VolumeDependencyTests-1626197307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a26a6d86-feab-4ab8-a766-5698a2058e4b" returned: 0 in 0.928s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:54 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4823a01f-a3aa-4190-a62f-c4bd990e3251 tempest-VolumeDependencyTests-1626197307 None] Lock "cinder-quobyte-a26a6d86-feab-4ab8-a766-5698a2058e4b" released by "delete_volume" :: held 1.888s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:19:54 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=87,cinder:INSERT=35,cinder:UPDATE=84,cinder:DELETE=11 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:19:54 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-4823a01f-a3aa-4190-a62f-c4bd990e3251 tempest-VolumeDependencyTests-1626197307 None] Created reservations ['c5adace6-06cd-4460-97c3-134fe04ee824', 'f87357c3-327a-4ed2-a6f1-142b218fd315', '78eee00a-a35b-4c97-901b-2d130278925f', 'b297f937-c608-4c71-a615-526af850137c'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:19:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4823a01f-a3aa-4190-a62f-c4bd990e3251 tempest-VolumeDependencyTests-1626197307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:19:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4823a01f-a3aa-4190-a62f-c4bd990e3251 tempest-VolumeDependencyTests-1626197307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:19:54 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-4823a01f-a3aa-4190-a62f-c4bd990e3251 tempest-VolumeDependencyTests-1626197307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:19:54 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-4823a01f-a3aa-4190-a62f-c4bd990e3251 tempest-VolumeDependencyTests-1626197307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:19:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4823a01f-a3aa-4190-a62f-c4bd990e3251 tempest-VolumeDependencyTests-1626197307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:19:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4823a01f-a3aa-4190-a62f-c4bd990e3251 tempest-VolumeDependencyTests-1626197307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:54 devstack sudo[100369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:19:54 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1a952a5e-ad95-490d-a0a4-53e6165ab927 tempest-VolumeDependencyTests-1626197307 None] Acquiring lock "cinder-a414b780-b82d-4825-b935-22adaac89692-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:19:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1a952a5e-ad95-490d-a0a4-53e6165ab927 tempest-VolumeDependencyTests-1626197307 None] Lock "cinder-a414b780-b82d-4825-b935-22adaac89692-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:19:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1a952a5e-ad95-490d-a0a4-53e6165ab927 tempest-VolumeDependencyTests-1626197307 None] Acquiring lock "cinder-quobyte-a414b780-b82d-4825-b935-22adaac89692" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:19:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1a952a5e-ad95-490d-a0a4-53e6165ab927 tempest-VolumeDependencyTests-1626197307 None] Lock "cinder-quobyte-a414b780-b82d-4825-b935-22adaac89692" acquired by "delete_volume" :: waited 0.026s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:19:55 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2089a25-d367-47da-afaf-1e932edb9eb5]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:19:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1a952a5e-ad95-490d-a0a4-53e6165ab927 tempest-VolumeDependencyTests-1626197307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a414b780-b82d-4825-b935-22adaac89692 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:55 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-f4c0d717-39d6-4f68-bd5b-ce829e257112 req-cb7c8825-8e84-46b6-9ebd-173df2e55649 tempest-TestShelveInstance-1977941275 None] Terminate volume connection completed successfully. Jul 10 18:19:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-f4c0d717-39d6-4f68-bd5b-ce829e257112 req-cb7c8825-8e84-46b6-9ebd-173df2e55649 tempest-TestShelveInstance-1977941275 None] Deleting attachment c9e37566-2090-42fb-a2c9-f0ce6799ab4e. {{(pid=87399) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 18:19:55 devstack sudo[100373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a414b780-b82d-4825-b935-22adaac89692 Jul 10 18:19:55 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:55 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4823a01f-a3aa-4190-a62f-c4bd990e3251 tempest-VolumeDependencyTests-1626197307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.963s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:55 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-4823a01f-a3aa-4190-a62f-c4bd990e3251 tempest-VolumeDependencyTests-1626197307 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:19:55 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-4823a01f-a3aa-4190-a62f-c4bd990e3251 tempest-VolumeDependencyTests-1626197307 None] Deleted volume successfully. Jul 10 18:19:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4823a01f-a3aa-4190-a62f-c4bd990e3251 tempest-VolumeDependencyTests-1626197307 None] Lock "cinder-a26a6d86-feab-4ab8-a766-5698a2058e4b-delete_volume" released by "delete_volume" :: held 3.121s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:19:56 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1a952a5e-ad95-490d-a0a4-53e6165ab927 tempest-VolumeDependencyTests-1626197307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a414b780-b82d-4825-b935-22adaac89692" returned: 0 in 1.074s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1a952a5e-ad95-490d-a0a4-53e6165ab927 tempest-VolumeDependencyTests-1626197307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a414b780-b82d-4825-b935-22adaac89692 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:56 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a414b780-b82d-4825-b935-22adaac89692 Jul 10 18:19:56 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:57 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1a952a5e-ad95-490d-a0a4-53e6165ab927 tempest-VolumeDependencyTests-1626197307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a414b780-b82d-4825-b935-22adaac89692" returned: 0 in 0.962s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1a952a5e-ad95-490d-a0a4-53e6165ab927 tempest-VolumeDependencyTests-1626197307 None] Lock "cinder-quobyte-a414b780-b82d-4825-b935-22adaac89692" released by "delete_volume" :: held 2.109s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:19:57 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-1a952a5e-ad95-490d-a0a4-53e6165ab927 tempest-VolumeDependencyTests-1626197307 None] Created reservations ['e66b1416-0096-4a87-9e28-7532cf79dffc', 'f30860a6-f47e-4564-a960-0ad2a47aed80', 'f07fc119-b41f-4f9b-8f55-3054a0e22c9b', 'a4fe53cd-4505-4c9e-85d0-0cb6f8128f56'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:19:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1a952a5e-ad95-490d-a0a4-53e6165ab927 tempest-VolumeDependencyTests-1626197307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:19:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1a952a5e-ad95-490d-a0a4-53e6165ab927 tempest-VolumeDependencyTests-1626197307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:19:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1a952a5e-ad95-490d-a0a4-53e6165ab927 tempest-VolumeDependencyTests-1626197307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:19:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1a952a5e-ad95-490d-a0a4-53e6165ab927 tempest-VolumeDependencyTests-1626197307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:19:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1a952a5e-ad95-490d-a0a4-53e6165ab927 tempest-VolumeDependencyTests-1626197307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:19:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1a952a5e-ad95-490d-a0a4-53e6165ab927 tempest-VolumeDependencyTests-1626197307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:57 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:19:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:19:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:19:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:19:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:19:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:19:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:57 devstack sudo[100384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:19:57 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:57 devstack sudo[100386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:19:57 devstack sudo[100386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:58 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1a952a5e-ad95-490d-a0a4-53e6165ab927 tempest-VolumeDependencyTests-1626197307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.061s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:58 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-1a952a5e-ad95-490d-a0a4-53e6165ab927 tempest-VolumeDependencyTests-1626197307 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:19:58 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-1a952a5e-ad95-490d-a0a4-53e6165ab927 tempest-VolumeDependencyTests-1626197307 None] Deleted volume successfully. Jul 10 18:19:58 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:19:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] Flow 'volume_create_manager' (2206a76d-a860-42f2-8131-368748e380d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:19:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9988454e-35b6-40eb-b23d-b2201bf8d503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:58 devstack sudo[100386]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.097s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:58 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:19:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9988454e-35b6-40eb-b23d-b2201bf8d503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-822398112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=068683ba-976b-45e7-b7a2-5fbad05d3e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4c1a0aaf2a4cd4bccad98d4be95586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:19:59Z,use_quota=True,user_id='76fb5232bb09498685ce66c7ec7c2aa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab0ee191-36aa-4f0f-a32b-86f6cfd9fcda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab0ee191-36aa-4f0f-a32b-86f6cfd9fcda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbd5ed9c-2d03-4ce8-bcaf-d337dfa75748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbd5ed9c-2d03-4ce8-bcaf-d337dfa75748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '068683ba-976b-45e7-b7a2-5fbad05d3e0e', 'volume_name': 'volume-068683ba-976b-45e7-b7a2-5fbad05d3e0e', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96bd483f-0ce9-4dac-8c4e-3d11d4ba258c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96bd483f-0ce9-4dac-8c4e-3d11d4ba258c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:19:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9793b22d-9635-40bb-90a9-d79cb8f833c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:19:58 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] Volume 068683ba-976b-45e7-b7a2-5fbad05d3e0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-068683ba-976b-45e7-b7a2-5fbad05d3e0e', 'volume_size': 1} Jul 10 18:19:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:19:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:19:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-822398112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=068683ba-976b-45e7-b7a2-5fbad05d3e0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4c1a0aaf2a4cd4bccad98d4be95586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:19:59Z,use_quota=True,user_id='76fb5232bb09498685ce66c7ec7c2aa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:19:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] Creating volume 068683ba-976b-45e7-b7a2-5fbad05d3e0e {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:19:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:19:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:19:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:19:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:19:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:19:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:19:58 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:19:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-068683ba-976b-45e7-b7a2-5fbad05d3e0e 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:58 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager._thread_info {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:19:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread count: 28 {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 18:19:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread info: [<_MainThread(MainThread, started 139757428633728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 18:19:58 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1a952a5e-ad95-490d-a0a4-53e6165ab927 tempest-VolumeDependencyTests-1626197307 None] Lock "cinder-a414b780-b82d-4825-b935-22adaac89692-delete_volume" released by "delete_volume" :: held 3.625s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:19:58 devstack sudo[100392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-068683ba-976b-45e7-b7a2-5fbad05d3e0e 1073741824 Jul 10 18:19:58 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:19:59 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root Jul 10 18:19:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-068683ba-976b-45e7-b7a2-5fbad05d3e0e 1073741824" returned: 0 in 1.073s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:19:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-068683ba-976b-45e7-b7a2-5fbad05d3e0e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:19:59 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-068683ba-976b-45e7-b7a2-5fbad05d3e0e Jul 10 18:19:59 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:20:00 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:20:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] Flow 'volume_create_manager' (c6548ab0-a993-442d-8398-c12c260d4e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:20:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a52ab26-f492-41cd-84f0-d82628d4127b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:20:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a52ab26-f492-41cd-84f0-d82628d4127b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1638274908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b475acb-1119-4eed-a7d1-e1dff4257357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5959ef76a8de4f2cb8e7113819129a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:20:00Z,use_quota=True,user_id='e9b01c20bfba460389c5557d523f4867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:20:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff680f2c-0d3b-49a3-b002-bfd086470a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:20:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff680f2c-0d3b-49a3-b002-bfd086470a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:20:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60587cc8-8d88-4147-b9e6-6291c12cb8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:20:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60587cc8-8d88-4147-b9e6-6291c12cb8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b475acb-1119-4eed-a7d1-e1dff4257357', 'volume_name': 'volume-7b475acb-1119-4eed-a7d1-e1dff4257357', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:20:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f1ec233-1321-4289-8f9d-471ec319aa01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:20:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f1ec233-1321-4289-8f9d-471ec319aa01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:20:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93fbab87-b164-4cd1-87da-3719403f6671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:20:00 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] Volume 7b475acb-1119-4eed-a7d1-e1dff4257357: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b475acb-1119-4eed-a7d1-e1dff4257357', 'volume_size': 1} Jul 10 18:20:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:20:00 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Jul 10 18:20:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-068683ba-976b-45e7-b7a2-5fbad05d3e0e" returned: 0 in 0.757s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:20:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:20:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.885s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:20:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.280s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:20:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:20:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1638274908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b475acb-1119-4eed-a7d1-e1dff4257357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5959ef76a8de4f2cb8e7113819129a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:20:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:20:00Z,use_quota=True,user_id='e9b01c20bfba460389c5557d523f4867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:20:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] Creating volume 7b475acb-1119-4eed-a7d1-e1dff4257357 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:20:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:20:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:20:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:20:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:20:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:20:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:20:00 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:20:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7b475acb-1119-4eed-a7d1-e1dff4257357 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:20:00 devstack sudo[100409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7b475acb-1119-4eed-a7d1-e1dff4257357 1073741824 Jul 10 18:20:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9793b22d-9635-40bb-90a9-d79cb8f833c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-068683ba-976b-45e7-b7a2-5fbad05d3e0e', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:20:00 devstack sudo[100409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:20:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db1189c-9d27-493e-ad92-57cb37429b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:20:00 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] Volume volume-068683ba-976b-45e7-b7a2-5fbad05d3e0e (068683ba-976b-45e7-b7a2-5fbad05d3e0e): created successfully Jul 10 18:20:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db1189c-9d27-493e-ad92-57cb37429b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:20:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] Flow 'volume_create_manager' (2206a76d-a860-42f2-8131-368748e380d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:20:00 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-164ac289-0d46-4a25-85e9-0c526b06e9c3 tempest-ProjectReaderTests-209705440 None] Created volume successfully. Jul 10 18:20:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-c19505db-a559-463b-aa75-ef16198fa46a req-c34c755b-62ed-4c19-b12f-7b220679fb4e tempest-TestShelveInstance-1977941275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:20:01 devstack sudo[100409]: pam_unix(sudo:session): session closed for user root Jul 10 18:20:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7b475acb-1119-4eed-a7d1-e1dff4257357 1073741824" returned: 0 in 0.869s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:20:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7b475acb-1119-4eed-a7d1-e1dff4257357 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:20:01 devstack sudo[100422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7b475acb-1119-4eed-a7d1-e1dff4257357 Jul 10 18:20:01 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:20:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-55c348f7-8bce-4695-9691-ebd8bfd183d4 tempest-ProjectReaderTests-209705440 None] Acquiring lock "cinder-068683ba-976b-45e7-b7a2-5fbad05d3e0e-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:20:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-55c348f7-8bce-4695-9691-ebd8bfd183d4 tempest-ProjectReaderTests-209705440 None] Lock "cinder-068683ba-976b-45e7-b7a2-5fbad05d3e0e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:20:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-55c348f7-8bce-4695-9691-ebd8bfd183d4 tempest-ProjectReaderTests-209705440 None] Acquiring lock "cinder-quobyte-068683ba-976b-45e7-b7a2-5fbad05d3e0e" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:20:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-55c348f7-8bce-4695-9691-ebd8bfd183d4 tempest-ProjectReaderTests-209705440 None] Lock "cinder-quobyte-068683ba-976b-45e7-b7a2-5fbad05d3e0e" acquired by "delete_volume" :: waited 0.018s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:20:02 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[420e718b-9503-420e-9bd3-a410b0929292]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:20:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-55c348f7-8bce-4695-9691-ebd8bfd183d4 tempest-ProjectReaderTests-209705440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-068683ba-976b-45e7-b7a2-5fbad05d3e0e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:20:02 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root Jul 10 18:20:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7b475acb-1119-4eed-a7d1-e1dff4257357" returned: 0 in 0.688s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:20:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:20:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:20:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-c19505db-a559-463b-aa75-ef16198fa46a req-c34c755b-62ed-4c19-b12f-7b220679fb4e tempest-TestShelveInstance-1977941275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.091s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:20:02 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93fbab87-b164-4cd1-87da-3719403f6671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b475acb-1119-4eed-a7d1-e1dff4257357', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:20:02 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b7aa89-8671-476f-bea6-5a7a5cf2b0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:20:02 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] Volume volume-7b475acb-1119-4eed-a7d1-e1dff4257357 (7b475acb-1119-4eed-a7d1-e1dff4257357): created successfully Jul 10 18:20:02 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3b7aa89-8671-476f-bea6-5a7a5cf2b0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:20:02 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] Flow 'volume_create_manager' (c6548ab0-a993-442d-8398-c12c260d4e63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:20:02 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[18787bd5-3935-47c9-ad83-0dbddca751c1]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:20:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-c19505db-a559-463b-aa75-ef16198fa46a req-c34c755b-62ed-4c19-b12f-7b220679fb4e tempest-TestShelveInstance-1977941275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:20:02 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-1e02aefb-f922-41b2-9b16-8792a2f3e598 tempest-AttachVolumeNegativeTest-1182710662 None] Created volume successfully. Jul 10 18:20:02 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-068683ba-976b-45e7-b7a2-5fbad05d3e0e Jul 10 18:20:02 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:20:02 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702 Jul 10 18:20:02 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:20:02 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Jul 10 18:20:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-55c348f7-8bce-4695-9691-ebd8bfd183d4 tempest-ProjectReaderTests-209705440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-068683ba-976b-45e7-b7a2-5fbad05d3e0e" returned: 0 in 0.794s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:20:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-55c348f7-8bce-4695-9691-ebd8bfd183d4 tempest-ProjectReaderTests-209705440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-068683ba-976b-45e7-b7a2-5fbad05d3e0e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:20:02 devstack sudo[100436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-068683ba-976b-45e7-b7a2-5fbad05d3e0e Jul 10 18:20:02 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:20:03 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Jul 10 18:20:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-c19505db-a559-463b-aa75-ef16198fa46a req-c34c755b-62ed-4c19-b12f-7b220679fb4e tempest-TestShelveInstance-1977941275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702" returned: 0 in 0.768s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:20:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-c19505db-a559-463b-aa75-ef16198fa46a req-c34c755b-62ed-4c19-b12f-7b220679fb4e tempest-TestShelveInstance-1977941275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:20:03 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702 Jul 10 18:20:03 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:20:03 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root Jul 10 18:20:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-55c348f7-8bce-4695-9691-ebd8bfd183d4 tempest-ProjectReaderTests-209705440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-068683ba-976b-45e7-b7a2-5fbad05d3e0e" returned: 0 in 0.682s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:20:03 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-55c348f7-8bce-4695-9691-ebd8bfd183d4 tempest-ProjectReaderTests-209705440 None] Lock "cinder-quobyte-068683ba-976b-45e7-b7a2-5fbad05d3e0e" released by "delete_volume" :: held 1.531s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:20:03 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-55c348f7-8bce-4695-9691-ebd8bfd183d4 tempest-ProjectReaderTests-209705440 None] Created reservations ['18a7adda-2c30-494b-850d-299793a3d11d', 'f16ff6cd-3c7c-4db1-a6e7-36766211f36b', 'd0e97c9b-6ee7-4616-bbda-049fb64f88b0', 'fbf93a7e-b5f6-424e-9c67-a9253056dd0a'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:20:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-55c348f7-8bce-4695-9691-ebd8bfd183d4 tempest-ProjectReaderTests-209705440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:20:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-55c348f7-8bce-4695-9691-ebd8bfd183d4 tempest-ProjectReaderTests-209705440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:20:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-55c348f7-8bce-4695-9691-ebd8bfd183d4 tempest-ProjectReaderTests-209705440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:20:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-55c348f7-8bce-4695-9691-ebd8bfd183d4 tempest-ProjectReaderTests-209705440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:20:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-55c348f7-8bce-4695-9691-ebd8bfd183d4 tempest-ProjectReaderTests-209705440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:20:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-55c348f7-8bce-4695-9691-ebd8bfd183d4 tempest-ProjectReaderTests-209705440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:20:03 devstack sudo[100447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:20:03 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:20:03 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Jul 10 18:20:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-c19505db-a559-463b-aa75-ef16198fa46a req-c34c755b-62ed-4c19-b12f-7b220679fb4e tempest-TestShelveInstance-1977941275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702" returned: 1 in 0.798s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:20:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-c19505db-a559-463b-aa75-ef16198fa46a req-c34c755b-62ed-4c19-b12f-7b220679fb4e tempest-TestShelveInstance-1977941275 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:20:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-c19505db-a559-463b-aa75-ef16198fa46a req-c34c755b-62ed-4c19-b12f-7b220679fb4e tempest-TestShelveInstance-1977941275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.638s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:20:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-c19505db-a559-463b-aa75-ef16198fa46a req-c34c755b-62ed-4c19-b12f-7b220679fb4e tempest-TestShelveInstance-1977941275 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd', 'name': 'volume-f0e1a3d9-dc7e-406f-b246-f535bf020702', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a9a0765c-09dc-4662-ba34-151e6971424b', 'enforce_multipath': True} {{(pid=87399) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 18:20:03 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-c19505db-a559-463b-aa75-ef16198fa46a req-c34c755b-62ed-4c19-b12f-7b220679fb4e tempest-TestShelveInstance-1977941275 None] attachment_update completed successfully. Jul 10 18:20:04 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root Jul 10 18:20:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-55c348f7-8bce-4695-9691-ebd8bfd183d4 tempest-ProjectReaderTests-209705440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.714s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:20:04 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-55c348f7-8bce-4695-9691-ebd8bfd183d4 tempest-ProjectReaderTests-209705440 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:20:04 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-55c348f7-8bce-4695-9691-ebd8bfd183d4 tempest-ProjectReaderTests-209705440 None] Deleted volume successfully. Jul 10 18:20:04 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-55c348f7-8bce-4695-9691-ebd8bfd183d4 tempest-ProjectReaderTests-209705440 None] Lock "cinder-068683ba-976b-45e7-b7a2-5fbad05d3e0e-delete_volume" released by "delete_volume" :: held 2.447s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:20:04 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:20:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] Flow 'volume_create_manager' (6e56a73d-6197-425c-a30f-dd154a137109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:20:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18eba246-ce77-4819-80a0-780fbac8b9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:20:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18eba246-ce77-4819-80a0-780fbac8b9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-878220584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b50cdf45-2797-4ea8-a770-46e5d29c6e21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4c1a0aaf2a4cd4bccad98d4be95586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:20:05Z,use_quota=True,user_id='76fb5232bb09498685ce66c7ec7c2aa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:20:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2e4f0de-ddde-4d0c-80d6-b135d36f6091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:20:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2e4f0de-ddde-4d0c-80d6-b135d36f6091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:20:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2984e285-d8a4-49bb-9167-1d286c619fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:20:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2984e285-d8a4-49bb-9167-1d286c619fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b50cdf45-2797-4ea8-a770-46e5d29c6e21', 'volume_name': 'volume-b50cdf45-2797-4ea8-a770-46e5d29c6e21', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:20:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca3201ac-ecfb-4344-ac66-c054c9fbbc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:20:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca3201ac-ecfb-4344-ac66-c054c9fbbc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:20:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f920af73-c3a6-46b8-a669-61414fefd3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:20:04 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] Volume b50cdf45-2797-4ea8-a770-46e5d29c6e21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b50cdf45-2797-4ea8-a770-46e5d29c6e21', 'volume_size': 1} Jul 10 18:20:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:20:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:20:04 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:20:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-878220584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b50cdf45-2797-4ea8-a770-46e5d29c6e21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e4c1a0aaf2a4cd4bccad98d4be95586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:20:05Z,use_quota=True,user_id='76fb5232bb09498685ce66c7ec7c2aa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:20:04 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] Creating volume b50cdf45-2797-4ea8-a770-46e5d29c6e21 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:20:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:20:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:20:04 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:20:04 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:20:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:20:04 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:20:04 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:20:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b50cdf45-2797-4ea8-a770-46e5d29c6e21 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:20:04 devstack sudo[100450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b50cdf45-2797-4ea8-a770-46e5d29c6e21 1073741824 Jul 10 18:20:04 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:20:05 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root Jul 10 18:20:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b50cdf45-2797-4ea8-a770-46e5d29c6e21 1073741824" returned: 0 in 0.903s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:20:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b50cdf45-2797-4ea8-a770-46e5d29c6e21 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:20:05 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b50cdf45-2797-4ea8-a770-46e5d29c6e21 Jul 10 18:20:05 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:20:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-a77ae24b-7c6e-4676-bb3f-e227d32e5dfc req-7562123d-5956-4b87-a0a7-14cc21d2160a tempest-AttachVolumeNegativeTest-1182710662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:20:06 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Jul 10 18:20:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b50cdf45-2797-4ea8-a770-46e5d29c6e21" returned: 0 in 0.662s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:20:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:20:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.610s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:20:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-a77ae24b-7c6e-4676-bb3f-e227d32e5dfc req-7562123d-5956-4b87-a0a7-14cc21d2160a tempest-AttachVolumeNegativeTest-1182710662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.075s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:20:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f920af73-c3a6-46b8-a669-61414fefd3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b50cdf45-2797-4ea8-a770-46e5d29c6e21', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:20:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff02abd6-6e74-4e64-8e74-964987287cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:20:06 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[33760aa7-8f20-4b46-898a-6d1c85345a06]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:20:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-a77ae24b-7c6e-4676-bb3f-e227d32e5dfc req-7562123d-5956-4b87-a0a7-14cc21d2160a tempest-AttachVolumeNegativeTest-1182710662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7b475acb-1119-4eed-a7d1-e1dff4257357 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:20:06 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] Volume volume-b50cdf45-2797-4ea8-a770-46e5d29c6e21 (b50cdf45-2797-4ea8-a770-46e5d29c6e21): created successfully Jul 10 18:20:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff02abd6-6e74-4e64-8e74-964987287cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:20:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] Flow 'volume_create_manager' (6e56a73d-6197-425c-a30f-dd154a137109) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:20:06 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-59a6b0ca-9555-4711-bd62-f7a5c8fab4e6 tempest-ProjectReaderTests-209705440 None] Created volume successfully. Jul 10 18:20:06 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7b475acb-1119-4eed-a7d1-e1dff4257357 Jul 10 18:20:06 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:20:06 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8dd9ea3c-17cf-4a23-b23e-a56d687b3348 tempest-ProjectReaderTests-209705440 None] Acquiring lock "cinder-b50cdf45-2797-4ea8-a770-46e5d29c6e21-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:20:06 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8dd9ea3c-17cf-4a23-b23e-a56d687b3348 tempest-ProjectReaderTests-209705440 None] Lock "cinder-b50cdf45-2797-4ea8-a770-46e5d29c6e21-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:20:06 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8dd9ea3c-17cf-4a23-b23e-a56d687b3348 tempest-ProjectReaderTests-209705440 None] Acquiring lock "cinder-quobyte-b50cdf45-2797-4ea8-a770-46e5d29c6e21" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:20:06 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8dd9ea3c-17cf-4a23-b23e-a56d687b3348 tempest-ProjectReaderTests-209705440 None] Lock "cinder-quobyte-b50cdf45-2797-4ea8-a770-46e5d29c6e21" acquired by "delete_volume" :: waited 0.017s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:20:06 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66e8af2-485a-44ca-a5bd-94258e73f60c]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:20:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8dd9ea3c-17cf-4a23-b23e-a56d687b3348 tempest-ProjectReaderTests-209705440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b50cdf45-2797-4ea8-a770-46e5d29c6e21 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:20:07 devstack sudo[100470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b50cdf45-2797-4ea8-a770-46e5d29c6e21 Jul 10 18:20:07 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:20:07 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Jul 10 18:20:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-a77ae24b-7c6e-4676-bb3f-e227d32e5dfc req-7562123d-5956-4b87-a0a7-14cc21d2160a tempest-AttachVolumeNegativeTest-1182710662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7b475acb-1119-4eed-a7d1-e1dff4257357" returned: 0 in 0.807s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:20:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-a77ae24b-7c6e-4676-bb3f-e227d32e5dfc req-7562123d-5956-4b87-a0a7-14cc21d2160a tempest-AttachVolumeNegativeTest-1182710662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.832s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:20:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-a77ae24b-7c6e-4676-bb3f-e227d32e5dfc req-7562123d-5956-4b87-a0a7-14cc21d2160a tempest-AttachVolumeNegativeTest-1182710662 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd', 'name': 'volume-7b475acb-1119-4eed-a7d1-e1dff4257357', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b0263024-9f9c-4825-9a6f-3af6fcbc7fb4', 'enforce_multipath': True} {{(pid=87399) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 18:20:07 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-a77ae24b-7c6e-4676-bb3f-e227d32e5dfc req-7562123d-5956-4b87-a0a7-14cc21d2160a tempest-AttachVolumeNegativeTest-1182710662 None] attachment_update completed successfully. Jul 10 18:20:07 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root Jul 10 18:20:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8dd9ea3c-17cf-4a23-b23e-a56d687b3348 tempest-ProjectReaderTests-209705440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b50cdf45-2797-4ea8-a770-46e5d29c6e21" returned: 0 in 0.801s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:20:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8dd9ea3c-17cf-4a23-b23e-a56d687b3348 tempest-ProjectReaderTests-209705440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b50cdf45-2797-4ea8-a770-46e5d29c6e21 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:20:07 devstack sudo[100478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b50cdf45-2797-4ea8-a770-46e5d29c6e21 Jul 10 18:20:07 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:20:08 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root Jul 10 18:20:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8dd9ea3c-17cf-4a23-b23e-a56d687b3348 tempest-ProjectReaderTests-209705440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b50cdf45-2797-4ea8-a770-46e5d29c6e21" returned: 0 in 0.718s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:20:08 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8dd9ea3c-17cf-4a23-b23e-a56d687b3348 tempest-ProjectReaderTests-209705440 None] Lock "cinder-quobyte-b50cdf45-2797-4ea8-a770-46e5d29c6e21" released by "delete_volume" :: held 1.560s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:20:08 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-8dd9ea3c-17cf-4a23-b23e-a56d687b3348 tempest-ProjectReaderTests-209705440 None] Created reservations ['5d1bc521-bb8e-45f2-bd2f-c64df56e0a19', '748bf84a-a933-4f1a-a5df-c64cca73b22f', '052f6dc9-1caf-479d-90b6-c3fd036388c3', '49bb12b1-8fbe-4e0c-82bc-fb3426b03dc0'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:20:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8dd9ea3c-17cf-4a23-b23e-a56d687b3348 tempest-ProjectReaderTests-209705440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:20:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8dd9ea3c-17cf-4a23-b23e-a56d687b3348 tempest-ProjectReaderTests-209705440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:20:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8dd9ea3c-17cf-4a23-b23e-a56d687b3348 tempest-ProjectReaderTests-209705440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:20:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8dd9ea3c-17cf-4a23-b23e-a56d687b3348 tempest-ProjectReaderTests-209705440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:20:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8dd9ea3c-17cf-4a23-b23e-a56d687b3348 tempest-ProjectReaderTests-209705440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:20:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8dd9ea3c-17cf-4a23-b23e-a56d687b3348 tempest-ProjectReaderTests-209705440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:20:08 devstack sudo[100548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:20:08 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:20:09 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root Jul 10 18:20:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8dd9ea3c-17cf-4a23-b23e-a56d687b3348 tempest-ProjectReaderTests-209705440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.808s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:20:09 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-8dd9ea3c-17cf-4a23-b23e-a56d687b3348 tempest-ProjectReaderTests-209705440 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:20:09 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-8dd9ea3c-17cf-4a23-b23e-a56d687b3348 tempest-ProjectReaderTests-209705440 None] Deleted volume successfully. Jul 10 18:20:09 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8dd9ea3c-17cf-4a23-b23e-a56d687b3348 tempest-ProjectReaderTests-209705440 None] Lock "cinder-b50cdf45-2797-4ea8-a770-46e5d29c6e21-delete_volume" released by "delete_volume" :: held 2.578s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:20:14 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-292c7c0b-2872-4f3e-a97c-84ba50203077 req-78ecd0bd-7649-4fd5-91c6-945c7bcb1ad6 tempest-AttachVolumeNegativeTest-1182710662 None] Terminate volume connection completed successfully. Jul 10 18:20:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-292c7c0b-2872-4f3e-a97c-84ba50203077 req-78ecd0bd-7649-4fd5-91c6-945c7bcb1ad6 tempest-AttachVolumeNegativeTest-1182710662 None] Deleting attachment b0263024-9f9c-4825-9a6f-3af6fcbc7fb4. {{(pid=87399) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 18:20:17 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-c19505db-a559-463b-aa75-ef16198fa46a req-1f6d6983-537e-4465-be3b-ea6bcb7863cd tempest-TestShelveInstance-1977941275 None] Terminate volume connection completed successfully. Jul 10 18:20:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-c19505db-a559-463b-aa75-ef16198fa46a req-1f6d6983-537e-4465-be3b-ea6bcb7863cd tempest-TestShelveInstance-1977941275 None] Deleting attachment a9a0765c-09dc-4662-ba34-151e6971424b. {{(pid=87399) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 18:20:27 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=36,cinder:INSERT=9,cinder:UPDATE=42,cinder:DELETE=3 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:20:27 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:UPDATE=45,cinder:SELECT=41,cinder:DELETE=4,cinder:INSERT=10 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:20:36 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:20:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] Flow 'volume_create_manager' (a3148756-c7a6-4e85-a338-1534fd152426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:20:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d4325a-895e-4951-bf87-d409fce2907a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:20:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98d4325a-895e-4951-bf87-d409fce2907a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-284168270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c2ea2d-51e1-4457-8d49-6d580b2df967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='463e43fd6eb7464ebfd760251e9f71ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:20:36Z,use_quota=True,user_id='6835b17f9aa649fca0bece3a687b00f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:20:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19564370-f841-463b-84af-4f42c74ea8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:20:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19564370-f841-463b-84af-4f42c74ea8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:20:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (480d0a66-1937-4a2d-9aa4-68596512feb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:20:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (480d0a66-1937-4a2d-9aa4-68596512feb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76c2ea2d-51e1-4457-8d49-6d580b2df967', 'volume_name': 'volume-76c2ea2d-51e1-4457-8d49-6d580b2df967', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:20:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1609fc38-0f99-4bdd-a99d-c3987811ea99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:20:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1609fc38-0f99-4bdd-a99d-c3987811ea99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:20:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0da9934f-ca26-4511-9404-74daee482cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:20:36 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] Volume 76c2ea2d-51e1-4457-8d49-6d580b2df967: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76c2ea2d-51e1-4457-8d49-6d580b2df967', 'volume_size': 1} Jul 10 18:20:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:20:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:20:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-284168270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c2ea2d-51e1-4457-8d49-6d580b2df967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='463e43fd6eb7464ebfd760251e9f71ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:20:36Z,use_quota=True,user_id='6835b17f9aa649fca0bece3a687b00f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:20:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] Creating volume 76c2ea2d-51e1-4457-8d49-6d580b2df967 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:20:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:20:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:20:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:20:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:20:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:20:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:20:36 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:20:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:20:36 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967 1073741824 Jul 10 18:20:36 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:20:37 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Jul 10 18:20:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967 1073741824" returned: 0 in 1.133s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:20:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:20:37 devstack sudo[100996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967 Jul 10 18:20:37 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:20:38 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root Jul 10 18:20:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967" returned: 0 in 0.712s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:20:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] <== create_volume: return (1912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:20:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.914s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:20:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0da9934f-ca26-4511-9404-74daee482cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76c2ea2d-51e1-4457-8d49-6d580b2df967', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:20:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6995ead-d611-4967-8117-bdecbaa6e11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:20:38 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] Volume volume-76c2ea2d-51e1-4457-8d49-6d580b2df967 (76c2ea2d-51e1-4457-8d49-6d580b2df967): created successfully Jul 10 18:20:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6995ead-d611-4967-8117-bdecbaa6e11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:20:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] Flow 'volume_create_manager' (a3148756-c7a6-4e85-a338-1534fd152426) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:20:38 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-88cba142-3eab-4ca9-9269-9c6727fbe955 tempest-SnapshotDependencyTests-1237850627 None] Created volume successfully. Jul 10 18:20:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d1559818-a7df-47d8-88fb-cae1603185b2 tempest-SnapshotDependencyTests-1237850627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:20:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d1559818-a7df-47d8-88fb-cae1603185b2 tempest-SnapshotDependencyTests-1237850627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:20:39 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-d1559818-a7df-47d8-88fb-cae1603185b2 tempest-SnapshotDependencyTests-1237850627 None] Creating offline snapshot eebc269d-e79a-4aa7-a962-beb10560d9f2 of volume 76c2ea2d-51e1-4457-8d49-6d580b2df967 {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:20:39 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd787f21-0a70-4ef9-93b3-185adda14708]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:20:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d1559818-a7df-47d8-88fb-cae1603185b2 tempest-SnapshotDependencyTests-1237850627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:20:39 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967 Jul 10 18:20:39 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:20:40 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Jul 10 18:20:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d1559818-a7df-47d8-88fb-cae1603185b2 tempest-SnapshotDependencyTests-1237850627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967" returned: 0 in 1.102s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:20:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d1559818-a7df-47d8-88fb-cae1603185b2 tempest-SnapshotDependencyTests-1237850627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967.eebc269d-e79a-4aa7-a962-beb10560d9f2 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:20:40 devstack sudo[101066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967.eebc269d-e79a-4aa7-a962-beb10560d9f2 1G Jul 10 18:20:40 devstack sudo[101066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:20:41 devstack sudo[101066]: pam_unix(sudo:session): session closed for user root Jul 10 18:20:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d1559818-a7df-47d8-88fb-cae1603185b2 tempest-SnapshotDependencyTests-1237850627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967.eebc269d-e79a-4aa7-a962-beb10560d9f2 1G" returned: 0 in 0.877s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:20:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d1559818-a7df-47d8-88fb-cae1603185b2 tempest-SnapshotDependencyTests-1237850627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76c2ea2d-51e1-4457-8d49-6d580b2df967 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967.eebc269d-e79a-4aa7-a962-beb10560d9f2 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:20:41 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76c2ea2d-51e1-4457-8d49-6d580b2df967 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967.eebc269d-e79a-4aa7-a962-beb10560d9f2 Jul 10 18:20:41 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:20:42 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Jul 10 18:20:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d1559818-a7df-47d8-88fb-cae1603185b2 tempest-SnapshotDependencyTests-1237850627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76c2ea2d-51e1-4457-8d49-6d580b2df967 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967.eebc269d-e79a-4aa7-a962-beb10560d9f2" returned: 0 in 0.765s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:20:42 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-d1559818-a7df-47d8-88fb-cae1603185b2 tempest-SnapshotDependencyTests-1237850627 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967.eebc269d-e79a-4aa7-a962-beb10560d9f2 is being set with open permissions: ugo+rw Jul 10 18:20:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d1559818-a7df-47d8-88fb-cae1603185b2 tempest-SnapshotDependencyTests-1237850627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967.eebc269d-e79a-4aa7-a962-beb10560d9f2 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:20:42 devstack sudo[101097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967.eebc269d-e79a-4aa7-a962-beb10560d9f2 Jul 10 18:20:42 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:20:42 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root Jul 10 18:20:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d1559818-a7df-47d8-88fb-cae1603185b2 tempest-SnapshotDependencyTests-1237850627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967.eebc269d-e79a-4aa7-a962-beb10560d9f2" returned: 0 in 0.674s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:20:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d1559818-a7df-47d8-88fb-cae1603185b2 tempest-SnapshotDependencyTests-1237850627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:20:43 devstack sudo[101102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967.info Jul 10 18:20:43 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:20:43 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root Jul 10 18:20:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d1559818-a7df-47d8-88fb-cae1603185b2 tempest-SnapshotDependencyTests-1237850627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967.info" returned: 0 in 0.774s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:20:43 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-d1559818-a7df-47d8-88fb-cae1603185b2 tempest-SnapshotDependencyTests-1237850627 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967.info is being set with open permissions: ugo+rw Jul 10 18:20:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d1559818-a7df-47d8-88fb-cae1603185b2 tempest-SnapshotDependencyTests-1237850627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:20:43 devstack sudo[101105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967.info Jul 10 18:20:43 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:20:44 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root Jul 10 18:20:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d1559818-a7df-47d8-88fb-cae1603185b2 tempest-SnapshotDependencyTests-1237850627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967.info" returned: 0 in 0.723s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:20:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d1559818-a7df-47d8-88fb-cae1603185b2 tempest-SnapshotDependencyTests-1237850627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.017s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:20:44 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-d1559818-a7df-47d8-88fb-cae1603185b2 tempest-SnapshotDependencyTests-1237850627 None] Create snapshot completed successfully Jul 10 18:20:45 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:20:45 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Flow 'volume_create_manager' (ca15f4c4-b9b8-4531-9864-4059d7c64f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:20:45 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d03ef7-e290-43aa-9797-dec18bc27de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:20:45 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d03ef7-e290-43aa-9797-dec18bc27de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:20:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1690203-b2d0-43b6-9a72-8ec155b90941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='463e43fd6eb7464ebfd760251e9f71ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=eebc269d-e79a-4aa7-a962-beb10560d9f2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:20:45Z,use_quota=True,user_id='6835b17f9aa649fca0bece3a687b00f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:20:45 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78db67e7-d8ee-40cc-8cfc-42eafe849816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:20:45 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78db67e7-d8ee-40cc-8cfc-42eafe849816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:20:45 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c33235-4672-48af-941b-f7a8c5ddc115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:20:45 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c33235-4672-48af-941b-f7a8c5ddc115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b1690203-b2d0-43b6-9a72-8ec155b90941', 'volume_name': 'volume-b1690203-b2d0-43b6-9a72-8ec155b90941', 'volume_size': 1, 'snapshot_id': 'eebc269d-e79a-4aa7-a962-beb10560d9f2'}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:20:45 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f4fec5-526e-4630-90ff-24c50471e05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:20:45 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f4fec5-526e-4630-90ff-24c50471e05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:20:45 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d53caa7c-609c-4b2b-b1fc-266d3fac87ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:20:45 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Volume b1690203-b2d0-43b6-9a72-8ec155b90941: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b1690203-b2d0-43b6-9a72-8ec155b90941', 'volume_size': 1, 'snapshot_id': 'eebc269d-e79a-4aa7-a962-beb10560d9f2'} Jul 10 18:20:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:20:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:20:45 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Acquiring lock "cinder-quobyte-eebc269d-e79a-4aa7-a962-beb10560d9f2-b1690203-b2d0-43b6-9a72-8ec155b90941" by "_create_volume_from_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:20:45 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Lock "cinder-quobyte-eebc269d-e79a-4aa7-a962-beb10560d9f2-b1690203-b2d0-43b6-9a72-8ec155b90941" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:20:45 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Creating volume b1690203-b2d0-43b6-9a72-8ec155b90941 from snapshot eebc269d-e79a-4aa7-a962-beb10560d9f2 {{(pid=87399) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 18:20:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:20:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:20:45 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:20:45 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:20:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:20:45 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:20:45 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Acquiring lock "cinder-quobyte-b1690203-b2d0-43b6-9a72-8ec155b90941" by "_copy_volume_from_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:20:45 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Lock "cinder-quobyte-b1690203-b2d0-43b6-9a72-8ec155b90941" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:20:45 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] snapshot: eebc269d-e79a-4aa7-a962-beb10560d9f2, volume: b1690203-b2d0-43b6-9a72-8ec155b90941, {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 18:20:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:20:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:20:45 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:20:45 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:20:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:20:45 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[7749f335-f9c5-4d33-8139-294bb81fb91a]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:20:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967.eebc269d-e79a-4aa7-a962-beb10560d9f2 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:20:45 devstack sudo[101108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967.eebc269d-e79a-4aa7-a962-beb10560d9f2 Jul 10 18:20:45 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:20:46 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root Jul 10 18:20:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967.eebc269d-e79a-4aa7-a962-beb10560d9f2" returned: 0 in 0.876s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:20:46 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76c2ea2d-51e1-4457-8d49-6d580b2df967(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:20:46 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] will copy from snapshot at /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967 {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 18:20:46 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Creating direct copy from snapshot {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 18:20:46 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6df22ae-9ea6-4b4e-b0e2-aa51895f2ba5]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:20:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:20:46 devstack sudo[101116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967 Jul 10 18:20:46 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:20:47 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root Jul 10 18:20:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967" returned: 0 in 0.880s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:20:47 devstack cinder-volume[87399]: DEBUG cinder.utils [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Path /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b1690203-b2d0-43b6-9a72-8ec155b90941 not found in is_blk_device check {{(pid=87399) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 18:20:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b1690203-b2d0-43b6-9a72-8ec155b90941 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:20:47 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b1690203-b2d0-43b6-9a72-8ec155b90941 Jul 10 18:20:47 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:20:52 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Jul 10 18:20:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b1690203-b2d0-43b6-9a72-8ec155b90941" returned: 0 in 5.255s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:20:52 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[708a75cc-7dcd-4617-ab85-b7a69cca741c]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:20:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:20:52 devstack sudo[101170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967 Jul 10 18:20:52 devstack sudo[101170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:20:53 devstack sudo[101170]: pam_unix(sudo:session): session closed for user root Jul 10 18:20:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967" returned: 0 in 0.987s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:20:53 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Image conversion details: src /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967, size 1024.00 MB, duration 5.26 sec, destination /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b1690203-b2d0-43b6-9a72-8ec155b90941 {{(pid=87399) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 18:20:53 devstack cinder-volume[87399]: INFO cinder.image.image_utils [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Converted 1024.00 MB image at 194.80 MB/s Jul 10 18:20:53 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b1690203-b2d0-43b6-9a72-8ec155b90941 is being set with open permissions: ugo+rw Jul 10 18:20:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b1690203-b2d0-43b6-9a72-8ec155b90941 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:20:53 devstack sudo[101175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b1690203-b2d0-43b6-9a72-8ec155b90941 Jul 10 18:20:53 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:20:54 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root Jul 10 18:20:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b1690203-b2d0-43b6-9a72-8ec155b90941" returned: 0 in 0.684s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:20:54 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Lock "cinder-quobyte-b1690203-b2d0-43b6-9a72-8ec155b90941" released by "_copy_volume_from_snapshot" :: held 8.806s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:20:54 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Lock "cinder-quobyte-eebc269d-e79a-4aa7-a962-beb10560d9f2-b1690203-b2d0-43b6-9a72-8ec155b90941" released by "_create_volume_from_snapshot" :: held 8.850s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:20:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.874s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:20:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d53caa7c-609c-4b2b-b1fc-266d3fac87ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1690203-b2d0-43b6-9a72-8ec155b90941', 'volume_size': 1, 'snapshot_id': 'eebc269d-e79a-4aa7-a962-beb10560d9f2'}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:20:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43317ba1-e26a-4c4e-be8c-ee2e0bdc2930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:20:54 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Volume volume-b1690203-b2d0-43b6-9a72-8ec155b90941 (b1690203-b2d0-43b6-9a72-8ec155b90941): created successfully Jul 10 18:20:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43317ba1-e26a-4c4e-be8c-ee2e0bdc2930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:20:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Flow 'volume_create_manager' (ca15f4c4-b9b8-4531-9864-4059d7c64f50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:20:54 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-11362747-d05c-4e28-9e17-f04c2e121945 tempest-SnapshotDependencyTests-1237850627 None] Created volume successfully. Jul 10 18:20:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5ea51622-f8d2-4e0d-8ca2-8d4d8ef91660 tempest-SnapshotDependencyTests-1237850627 None] Acquiring lock "cinder-eebc269d-e79a-4aa7-a962-beb10560d9f2-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:20:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5ea51622-f8d2-4e0d-8ca2-8d4d8ef91660 tempest-SnapshotDependencyTests-1237850627 None] Lock "cinder-eebc269d-e79a-4aa7-a962-beb10560d9f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:20:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5ea51622-f8d2-4e0d-8ca2-8d4d8ef91660 tempest-SnapshotDependencyTests-1237850627 None] Acquiring lock "cinder-quobyte-76c2ea2d-51e1-4457-8d49-6d580b2df967" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:20:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5ea51622-f8d2-4e0d-8ca2-8d4d8ef91660 tempest-SnapshotDependencyTests-1237850627 None] Lock "cinder-quobyte-76c2ea2d-51e1-4457-8d49-6d580b2df967" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:20:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5ea51622-f8d2-4e0d-8ca2-8d4d8ef91660 tempest-SnapshotDependencyTests-1237850627 None] Acquiring lock "cinder-quobyte-eebc269d-e79a-4aa7-a962-beb10560d9f2" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:20:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5ea51622-f8d2-4e0d-8ca2-8d4d8ef91660 tempest-SnapshotDependencyTests-1237850627 None] Lock "cinder-quobyte-eebc269d-e79a-4aa7-a962-beb10560d9f2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:20:55 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-5ea51622-f8d2-4e0d-8ca2-8d4d8ef91660 tempest-SnapshotDependencyTests-1237850627 None] Deleting offline snapshot eebc269d-e79a-4aa7-a962-beb10560d9f2 of volume 76c2ea2d-51e1-4457-8d49-6d580b2df967 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:20:55 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-5ea51622-f8d2-4e0d-8ca2-8d4d8ef91660 tempest-SnapshotDependencyTests-1237850627 None] snapshot_file for this snap is: volume-76c2ea2d-51e1-4457-8d49-6d580b2df967.eebc269d-e79a-4aa7-a962-beb10560d9f2 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:20:55 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[efce72c5-c4f1-41b8-8ebd-36a0af9cfdbf]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:20:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5ea51622-f8d2-4e0d-8ca2-8d4d8ef91660 tempest-SnapshotDependencyTests-1237850627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967.eebc269d-e79a-4aa7-a962-beb10560d9f2 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:20:55 devstack sudo[101180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967.eebc269d-e79a-4aa7-a962-beb10560d9f2 Jul 10 18:20:55 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:20:56 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root Jul 10 18:20:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5ea51622-f8d2-4e0d-8ca2-8d4d8ef91660 tempest-SnapshotDependencyTests-1237850627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967.eebc269d-e79a-4aa7-a962-beb10560d9f2" returned: 0 in 0.839s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:20:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-5ea51622-f8d2-4e0d-8ca2-8d4d8ef91660 tempest-SnapshotDependencyTests-1237850627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76c2ea2d-51e1-4457-8d49-6d580b2df967(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:20:56 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7142e9f-1506-47f7-886c-d3773c98a2cd]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:20:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5ea51622-f8d2-4e0d-8ca2-8d4d8ef91660 tempest-SnapshotDependencyTests-1237850627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:20:56 devstack sudo[101206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967 Jul 10 18:20:56 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:20:57 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root Jul 10 18:20:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5ea51622-f8d2-4e0d-8ca2-8d4d8ef91660 tempest-SnapshotDependencyTests-1237850627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967" returned: 0 in 0.775s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:20:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5ea51622-f8d2-4e0d-8ca2-8d4d8ef91660 tempest-SnapshotDependencyTests-1237850627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967.eebc269d-e79a-4aa7-a962-beb10560d9f2 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:20:57 devstack sudo[101211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967.eebc269d-e79a-4aa7-a962-beb10560d9f2 Jul 10 18:20:57 devstack sudo[101211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:20:57 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:20:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:20:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:20:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:20:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:20:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:20:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:20:57 devstack sudo[101213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:20:57 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:20:58 devstack sudo[101211]: pam_unix(sudo:session): session closed for user root Jul 10 18:20:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5ea51622-f8d2-4e0d-8ca2-8d4d8ef91660 tempest-SnapshotDependencyTests-1237850627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967.eebc269d-e79a-4aa7-a962-beb10560d9f2" returned: 0 in 0.728s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:20:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5ea51622-f8d2-4e0d-8ca2-8d4d8ef91660 tempest-SnapshotDependencyTests-1237850627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967.eebc269d-e79a-4aa7-a962-beb10560d9f2 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:20:58 devstack sudo[101218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967.eebc269d-e79a-4aa7-a962-beb10560d9f2 Jul 10 18:20:58 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:20:58 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root Jul 10 18:20:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.678s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:20:58 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:20:58 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager._thread_info {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:20:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread count: 28 {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 18:20:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread info: [<_MainThread(MainThread, started 139757428633728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 18:20:58 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root Jul 10 18:20:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5ea51622-f8d2-4e0d-8ca2-8d4d8ef91660 tempest-SnapshotDependencyTests-1237850627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967.eebc269d-e79a-4aa7-a962-beb10560d9f2" returned: 0 in 0.662s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:20:58 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5ea51622-f8d2-4e0d-8ca2-8d4d8ef91660 tempest-SnapshotDependencyTests-1237850627 None] Lock "cinder-quobyte-eebc269d-e79a-4aa7-a962-beb10560d9f2" released by "_delete_snapshot" :: held 3.103s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:20:58 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5ea51622-f8d2-4e0d-8ca2-8d4d8ef91660 tempest-SnapshotDependencyTests-1237850627 None] Lock "cinder-quobyte-76c2ea2d-51e1-4457-8d49-6d580b2df967" released by "delete_snapshot" :: held 3.125s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:20:58 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-5ea51622-f8d2-4e0d-8ca2-8d4d8ef91660 tempest-SnapshotDependencyTests-1237850627 None] Created reservations ['3c4f5d45-dacd-4e4e-9d8e-569a862af5c7', '59f55c5b-fdaf-4721-a587-b5c6a24dce99', '7b2c7153-9138-4fa7-b372-f430bda99fad', 'ea06e785-6f97-4a58-9e33-7e0e9f3d5283'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:20:58 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-5ea51622-f8d2-4e0d-8ca2-8d4d8ef91660 tempest-SnapshotDependencyTests-1237850627 None] Delete snapshot completed successfully. Jul 10 18:20:58 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5ea51622-f8d2-4e0d-8ca2-8d4d8ef91660 tempest-SnapshotDependencyTests-1237850627 None] Lock "cinder-eebc269d-e79a-4aa7-a962-beb10560d9f2-delete_snapshot" released by "delete_snapshot" :: held 3.247s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:20:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1095c458-6530-4ca7-b0f5-1f5a8923e9f0 tempest-SnapshotDependencyTests-1237850627 None] Acquiring lock "cinder-76c2ea2d-51e1-4457-8d49-6d580b2df967-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:20:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1095c458-6530-4ca7-b0f5-1f5a8923e9f0 tempest-SnapshotDependencyTests-1237850627 None] Lock "cinder-76c2ea2d-51e1-4457-8d49-6d580b2df967-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:20:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1095c458-6530-4ca7-b0f5-1f5a8923e9f0 tempest-SnapshotDependencyTests-1237850627 None] Acquiring lock "cinder-quobyte-76c2ea2d-51e1-4457-8d49-6d580b2df967" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:20:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1095c458-6530-4ca7-b0f5-1f5a8923e9f0 tempest-SnapshotDependencyTests-1237850627 None] Lock "cinder-quobyte-76c2ea2d-51e1-4457-8d49-6d580b2df967" acquired by "delete_volume" :: waited 0.016s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:20:59 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[e649c5f1-106e-4a75-b08e-8d4878453dc9]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:20:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1095c458-6530-4ca7-b0f5-1f5a8923e9f0 tempest-SnapshotDependencyTests-1237850627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:21:00 devstack sudo[101228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967 Jul 10 18:21:00 devstack sudo[101228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:21:00 devstack sudo[101228]: pam_unix(sudo:session): session closed for user root Jul 10 18:21:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1095c458-6530-4ca7-b0f5-1f5a8923e9f0 tempest-SnapshotDependencyTests-1237850627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967" returned: 0 in 0.757s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:21:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1095c458-6530-4ca7-b0f5-1f5a8923e9f0 tempest-SnapshotDependencyTests-1237850627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:21:00 devstack sudo[101233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967 Jul 10 18:21:00 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:21:01 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root Jul 10 18:21:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1095c458-6530-4ca7-b0f5-1f5a8923e9f0 tempest-SnapshotDependencyTests-1237850627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-76c2ea2d-51e1-4457-8d49-6d580b2df967" returned: 0 in 0.662s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:21:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1095c458-6530-4ca7-b0f5-1f5a8923e9f0 tempest-SnapshotDependencyTests-1237850627 None] Lock "cinder-quobyte-76c2ea2d-51e1-4457-8d49-6d580b2df967" released by "delete_volume" :: held 1.476s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:21:01 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-1095c458-6530-4ca7-b0f5-1f5a8923e9f0 tempest-SnapshotDependencyTests-1237850627 None] Created reservations ['ea7d0872-1425-4b9c-b11f-0d678263f750', '85072213-5c63-43d8-8a77-fd083bed3529', '73e7094d-6a3b-4c01-abba-346c86096e64', 'be7e899f-77f1-4ee6-a865-34330d561f5c'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:21:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1095c458-6530-4ca7-b0f5-1f5a8923e9f0 tempest-SnapshotDependencyTests-1237850627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:21:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1095c458-6530-4ca7-b0f5-1f5a8923e9f0 tempest-SnapshotDependencyTests-1237850627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:21:01 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1095c458-6530-4ca7-b0f5-1f5a8923e9f0 tempest-SnapshotDependencyTests-1237850627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:21:01 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1095c458-6530-4ca7-b0f5-1f5a8923e9f0 tempest-SnapshotDependencyTests-1237850627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:21:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1095c458-6530-4ca7-b0f5-1f5a8923e9f0 tempest-SnapshotDependencyTests-1237850627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:21:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1095c458-6530-4ca7-b0f5-1f5a8923e9f0 tempest-SnapshotDependencyTests-1237850627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:21:01 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:21:01 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:21:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-502a07bd-ba19-409d-bf6b-9d66c4f2d9ee tempest-SnapshotDependencyTests-1237850627 None] Acquiring lock "cinder-b1690203-b2d0-43b6-9a72-8ec155b90941-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:21:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-502a07bd-ba19-409d-bf6b-9d66c4f2d9ee tempest-SnapshotDependencyTests-1237850627 None] Lock "cinder-b1690203-b2d0-43b6-9a72-8ec155b90941-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:21:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-502a07bd-ba19-409d-bf6b-9d66c4f2d9ee tempest-SnapshotDependencyTests-1237850627 None] Acquiring lock "cinder-quobyte-b1690203-b2d0-43b6-9a72-8ec155b90941" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:21:02 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Jul 10 18:21:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1095c458-6530-4ca7-b0f5-1f5a8923e9f0 tempest-SnapshotDependencyTests-1237850627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.692s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:21:02 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-1095c458-6530-4ca7-b0f5-1f5a8923e9f0 tempest-SnapshotDependencyTests-1237850627 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:21:02 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-1095c458-6530-4ca7-b0f5-1f5a8923e9f0 tempest-SnapshotDependencyTests-1237850627 None] Deleted volume successfully. Jul 10 18:21:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-502a07bd-ba19-409d-bf6b-9d66c4f2d9ee tempest-SnapshotDependencyTests-1237850627 None] Lock "cinder-quobyte-b1690203-b2d0-43b6-9a72-8ec155b90941" acquired by "delete_volume" :: waited 0.041s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:21:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1095c458-6530-4ca7-b0f5-1f5a8923e9f0 tempest-SnapshotDependencyTests-1237850627 None] Lock "cinder-76c2ea2d-51e1-4457-8d49-6d580b2df967-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:21:02 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4c81f2-2b9f-437f-b63b-b790d93c3b30]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:21:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-502a07bd-ba19-409d-bf6b-9d66c4f2d9ee tempest-SnapshotDependencyTests-1237850627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b1690203-b2d0-43b6-9a72-8ec155b90941 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:21:02 devstack sudo[101239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b1690203-b2d0-43b6-9a72-8ec155b90941 Jul 10 18:21:02 devstack sudo[101239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:21:02 devstack sudo[101239]: pam_unix(sudo:session): session closed for user root Jul 10 18:21:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-502a07bd-ba19-409d-bf6b-9d66c4f2d9ee tempest-SnapshotDependencyTests-1237850627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b1690203-b2d0-43b6-9a72-8ec155b90941" returned: 0 in 0.780s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:21:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-502a07bd-ba19-409d-bf6b-9d66c4f2d9ee tempest-SnapshotDependencyTests-1237850627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b1690203-b2d0-43b6-9a72-8ec155b90941 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:21:03 devstack sudo[101244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b1690203-b2d0-43b6-9a72-8ec155b90941 Jul 10 18:21:03 devstack sudo[101244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:21:03 devstack sudo[101244]: pam_unix(sudo:session): session closed for user root Jul 10 18:21:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-502a07bd-ba19-409d-bf6b-9d66c4f2d9ee tempest-SnapshotDependencyTests-1237850627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b1690203-b2d0-43b6-9a72-8ec155b90941" returned: 0 in 0.679s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:21:03 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-502a07bd-ba19-409d-bf6b-9d66c4f2d9ee tempest-SnapshotDependencyTests-1237850627 None] Lock "cinder-quobyte-b1690203-b2d0-43b6-9a72-8ec155b90941" released by "delete_volume" :: held 1.508s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:21:03 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-502a07bd-ba19-409d-bf6b-9d66c4f2d9ee tempest-SnapshotDependencyTests-1237850627 None] Created reservations ['96518432-859a-463c-8121-cbacdc4a5b1c', 'c2890991-2d59-4909-90b5-2eee08627ea3', '18fc8ea6-f470-4c73-99a1-2a84bee70865', '02bdcb04-1bee-4791-a660-b6d341c1d1cb'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:21:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-502a07bd-ba19-409d-bf6b-9d66c4f2d9ee tempest-SnapshotDependencyTests-1237850627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:21:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-502a07bd-ba19-409d-bf6b-9d66c4f2d9ee tempest-SnapshotDependencyTests-1237850627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:21:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-502a07bd-ba19-409d-bf6b-9d66c4f2d9ee tempest-SnapshotDependencyTests-1237850627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:21:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-502a07bd-ba19-409d-bf6b-9d66c4f2d9ee tempest-SnapshotDependencyTests-1237850627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:21:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-502a07bd-ba19-409d-bf6b-9d66c4f2d9ee tempest-SnapshotDependencyTests-1237850627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:21:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-502a07bd-ba19-409d-bf6b-9d66c4f2d9ee tempest-SnapshotDependencyTests-1237850627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:21:03 devstack sudo[101247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:21:03 devstack sudo[101247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:21:04 devstack sudo[101247]: pam_unix(sudo:session): session closed for user root Jul 10 18:21:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-502a07bd-ba19-409d-bf6b-9d66c4f2d9ee tempest-SnapshotDependencyTests-1237850627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.676s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:21:04 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-502a07bd-ba19-409d-bf6b-9d66c4f2d9ee tempest-SnapshotDependencyTests-1237850627 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:21:04 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-502a07bd-ba19-409d-bf6b-9d66c4f2d9ee tempest-SnapshotDependencyTests-1237850627 None] Deleted volume successfully. Jul 10 18:21:04 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-502a07bd-ba19-409d-bf6b-9d66c4f2d9ee tempest-SnapshotDependencyTests-1237850627 None] Lock "cinder-b1690203-b2d0-43b6-9a72-8ec155b90941-delete_volume" released by "delete_volume" :: held 2.427s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:21:06 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:21:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] Flow 'volume_create_manager' (9fec5914-fad8-4a83-bbee-4192ff315011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:21:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1862509e-0734-44e5-99d5-cfba3d7a6e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:21:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1862509e-0734-44e5-99d5-cfba3d7a6e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1310003132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=701ef55a-dcbd-4d52-a408-a0b1b4c86d06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5959ef76a8de4f2cb8e7113819129a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:21:06Z,use_quota=True,user_id='e9b01c20bfba460389c5557d523f4867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:21:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9604b49-4e39-4385-ba4a-e7feabd7dfed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:21:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9604b49-4e39-4385-ba4a-e7feabd7dfed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:21:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10458d99-9eb5-4d4f-9c46-049aa419ea97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:21:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10458d99-9eb5-4d4f-9c46-049aa419ea97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '701ef55a-dcbd-4d52-a408-a0b1b4c86d06', 'volume_name': 'volume-701ef55a-dcbd-4d52-a408-a0b1b4c86d06', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:21:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7857206f-4e04-4066-9375-4e6fc6d725be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:21:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7857206f-4e04-4066-9375-4e6fc6d725be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:21:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b53ddc-ff4c-4b2a-a670-7d6cd776c8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:21:06 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] Volume 701ef55a-dcbd-4d52-a408-a0b1b4c86d06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-701ef55a-dcbd-4d52-a408-a0b1b4c86d06', 'volume_size': 1} Jul 10 18:21:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:21:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:21:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1310003132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=701ef55a-dcbd-4d52-a408-a0b1b4c86d06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5959ef76a8de4f2cb8e7113819129a52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:21:06Z,use_quota=True,user_id='e9b01c20bfba460389c5557d523f4867',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:21:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] Creating volume 701ef55a-dcbd-4d52-a408-a0b1b4c86d06 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:21:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:21:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:21:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:21:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:21:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:21:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:21:06 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:21:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-701ef55a-dcbd-4d52-a408-a0b1b4c86d06 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:21:06 devstack sudo[101255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-701ef55a-dcbd-4d52-a408-a0b1b4c86d06 1073741824 Jul 10 18:21:06 devstack sudo[101255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:21:07 devstack sudo[101255]: pam_unix(sudo:session): session closed for user root Jul 10 18:21:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-701ef55a-dcbd-4d52-a408-a0b1b4c86d06 1073741824" returned: 0 in 0.990s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:21:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-701ef55a-dcbd-4d52-a408-a0b1b4c86d06 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:21:07 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-701ef55a-dcbd-4d52-a408-a0b1b4c86d06 Jul 10 18:21:07 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:21:08 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Jul 10 18:21:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-701ef55a-dcbd-4d52-a408-a0b1b4c86d06" returned: 0 in 0.714s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:21:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:21:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.760s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:21:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b53ddc-ff4c-4b2a-a670-7d6cd776c8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-701ef55a-dcbd-4d52-a408-a0b1b4c86d06', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:21:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f9d4d5-7e58-4633-9991-d215616d558b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:21:08 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] Volume volume-701ef55a-dcbd-4d52-a408-a0b1b4c86d06 (701ef55a-dcbd-4d52-a408-a0b1b4c86d06): created successfully Jul 10 18:21:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f9d4d5-7e58-4633-9991-d215616d558b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:21:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] Flow 'volume_create_manager' (9fec5914-fad8-4a83-bbee-4192ff315011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:21:08 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-3ec0a1e2-9a66-4a4c-93e5-16adbe4a31c4 tempest-AttachVolumeNegativeTest-1182710662 None] Created volume successfully. Jul 10 18:21:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-24189bfb-41e2-4911-b02f-64b5f99ffb9a req-1359fcab-3f0c-4240-9de1-3017efa7aca3 tempest-AttachVolumeNegativeTest-1182710662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:21:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-24189bfb-41e2-4911-b02f-64b5f99ffb9a req-1359fcab-3f0c-4240-9de1-3017efa7aca3 tempest-AttachVolumeNegativeTest-1182710662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:21:11 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[89598e80-498e-4399-bf38-f5856f609dc2]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:21:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-24189bfb-41e2-4911-b02f-64b5f99ffb9a req-1359fcab-3f0c-4240-9de1-3017efa7aca3 tempest-AttachVolumeNegativeTest-1182710662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-701ef55a-dcbd-4d52-a408-a0b1b4c86d06 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:21:11 devstack sudo[101278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-701ef55a-dcbd-4d52-a408-a0b1b4c86d06 Jul 10 18:21:11 devstack sudo[101278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:21:12 devstack sudo[101278]: pam_unix(sudo:session): session closed for user root Jul 10 18:21:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-24189bfb-41e2-4911-b02f-64b5f99ffb9a req-1359fcab-3f0c-4240-9de1-3017efa7aca3 tempest-AttachVolumeNegativeTest-1182710662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-701ef55a-dcbd-4d52-a408-a0b1b4c86d06" returned: 0 in 0.821s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:21:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-24189bfb-41e2-4911-b02f-64b5f99ffb9a req-1359fcab-3f0c-4240-9de1-3017efa7aca3 tempest-AttachVolumeNegativeTest-1182710662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.843s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:21:12 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-24189bfb-41e2-4911-b02f-64b5f99ffb9a req-1359fcab-3f0c-4240-9de1-3017efa7aca3 tempest-AttachVolumeNegativeTest-1182710662 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd', 'name': 'volume-701ef55a-dcbd-4d52-a408-a0b1b4c86d06', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6fe8bfe5-bd62-4965-b343-2a7c76cf6ad3', 'enforce_multipath': True} {{(pid=87399) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 18:21:12 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-24189bfb-41e2-4911-b02f-64b5f99ffb9a req-1359fcab-3f0c-4240-9de1-3017efa7aca3 tempest-AttachVolumeNegativeTest-1182710662 None] attachment_update completed successfully. Jul 10 18:21:18 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-b0adf214-b704-401e-b90c-df8e6e8fb897 req-5184ba4d-0720-4043-b0ea-450c10e428bc tempest-AttachVolumeNegativeTest-1182710662 None] Terminate volume connection completed successfully. Jul 10 18:21:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-b0adf214-b704-401e-b90c-df8e6e8fb897 req-5184ba4d-0720-4043-b0ea-450c10e428bc tempest-AttachVolumeNegativeTest-1182710662 None] Deleting attachment 6fe8bfe5-bd62-4965-b343-2a7c76cf6ad3. {{(pid=87399) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 18:21:28 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-14086bb4-5400-4cf4-8e13-4e3feb0955fd tempest-AttachVolumeNegativeTest-1182710662 None] Acquiring lock "cinder-701ef55a-dcbd-4d52-a408-a0b1b4c86d06-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:21:28 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-14086bb4-5400-4cf4-8e13-4e3feb0955fd tempest-AttachVolumeNegativeTest-1182710662 None] Lock "cinder-701ef55a-dcbd-4d52-a408-a0b1b4c86d06-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:21:28 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=34,cinder:UPDATE=33,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:21:28 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:UPDATE=34,cinder:SELECT=32,cinder:INSERT=10,cinder:DELETE=4 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:21:28 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-14086bb4-5400-4cf4-8e13-4e3feb0955fd tempest-AttachVolumeNegativeTest-1182710662 None] Acquiring lock "cinder-quobyte-701ef55a-dcbd-4d52-a408-a0b1b4c86d06" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:21:28 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-14086bb4-5400-4cf4-8e13-4e3feb0955fd tempest-AttachVolumeNegativeTest-1182710662 None] Lock "cinder-quobyte-701ef55a-dcbd-4d52-a408-a0b1b4c86d06" acquired by "delete_volume" :: waited 0.018s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:21:28 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[0130d8ff-53a5-4e30-b402-b51f435303e4]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:21:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-14086bb4-5400-4cf4-8e13-4e3feb0955fd tempest-AttachVolumeNegativeTest-1182710662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-701ef55a-dcbd-4d52-a408-a0b1b4c86d06 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:21:28 devstack sudo[101726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-701ef55a-dcbd-4d52-a408-a0b1b4c86d06 Jul 10 18:21:28 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:21:29 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root Jul 10 18:21:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-14086bb4-5400-4cf4-8e13-4e3feb0955fd tempest-AttachVolumeNegativeTest-1182710662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-701ef55a-dcbd-4d52-a408-a0b1b4c86d06" returned: 0 in 0.754s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:21:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-14086bb4-5400-4cf4-8e13-4e3feb0955fd tempest-AttachVolumeNegativeTest-1182710662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-701ef55a-dcbd-4d52-a408-a0b1b4c86d06 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:21:29 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-701ef55a-dcbd-4d52-a408-a0b1b4c86d06 Jul 10 18:21:29 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:21:30 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Jul 10 18:21:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-14086bb4-5400-4cf4-8e13-4e3feb0955fd tempest-AttachVolumeNegativeTest-1182710662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-701ef55a-dcbd-4d52-a408-a0b1b4c86d06" returned: 0 in 0.684s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:21:30 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-14086bb4-5400-4cf4-8e13-4e3feb0955fd tempest-AttachVolumeNegativeTest-1182710662 None] Lock "cinder-quobyte-701ef55a-dcbd-4d52-a408-a0b1b4c86d06" released by "delete_volume" :: held 1.475s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:21:30 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-14086bb4-5400-4cf4-8e13-4e3feb0955fd tempest-AttachVolumeNegativeTest-1182710662 None] Created reservations ['2791d96c-fecd-4907-8f7d-849f10af9816', 'fb29381d-e46f-4267-8b60-f9b7450c7638', 'cd0c539b-e1d2-49d6-b0bb-c79ab45c4c56', '246d0b64-dcf9-4ed0-8f48-d8f5eb1694cf'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:21:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-14086bb4-5400-4cf4-8e13-4e3feb0955fd tempest-AttachVolumeNegativeTest-1182710662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:21:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-14086bb4-5400-4cf4-8e13-4e3feb0955fd tempest-AttachVolumeNegativeTest-1182710662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:21:30 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-14086bb4-5400-4cf4-8e13-4e3feb0955fd tempest-AttachVolumeNegativeTest-1182710662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:21:30 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-14086bb4-5400-4cf4-8e13-4e3feb0955fd tempest-AttachVolumeNegativeTest-1182710662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:21:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-14086bb4-5400-4cf4-8e13-4e3feb0955fd tempest-AttachVolumeNegativeTest-1182710662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:21:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-14086bb4-5400-4cf4-8e13-4e3feb0955fd tempest-AttachVolumeNegativeTest-1182710662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:21:30 devstack sudo[101736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:21:30 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:21:31 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ad649f06-a10f-4669-bd28-d7ae1738e646 tempest-AttachVolumeNegativeTest-1182710662 None] Acquiring lock "cinder-7b475acb-1119-4eed-a7d1-e1dff4257357-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:21:31 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root Jul 10 18:21:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-14086bb4-5400-4cf4-8e13-4e3feb0955fd tempest-AttachVolumeNegativeTest-1182710662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.674s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:21:31 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-14086bb4-5400-4cf4-8e13-4e3feb0955fd tempest-AttachVolumeNegativeTest-1182710662 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:21:31 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ad649f06-a10f-4669-bd28-d7ae1738e646 tempest-AttachVolumeNegativeTest-1182710662 None] Lock "cinder-7b475acb-1119-4eed-a7d1-e1dff4257357-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:21:31 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-14086bb4-5400-4cf4-8e13-4e3feb0955fd tempest-AttachVolumeNegativeTest-1182710662 None] Deleted volume successfully. Jul 10 18:21:31 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-14086bb4-5400-4cf4-8e13-4e3feb0955fd tempest-AttachVolumeNegativeTest-1182710662 None] Lock "cinder-701ef55a-dcbd-4d52-a408-a0b1b4c86d06-delete_volume" released by "delete_volume" :: held 2.363s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:21:31 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ad649f06-a10f-4669-bd28-d7ae1738e646 tempest-AttachVolumeNegativeTest-1182710662 None] Acquiring lock "cinder-quobyte-7b475acb-1119-4eed-a7d1-e1dff4257357" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:21:31 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ad649f06-a10f-4669-bd28-d7ae1738e646 tempest-AttachVolumeNegativeTest-1182710662 None] Lock "cinder-quobyte-7b475acb-1119-4eed-a7d1-e1dff4257357" acquired by "delete_volume" :: waited 0.016s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:21:31 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c0d1ad-a875-452c-b04e-0d7636af89ec]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:21:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ad649f06-a10f-4669-bd28-d7ae1738e646 tempest-AttachVolumeNegativeTest-1182710662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7b475acb-1119-4eed-a7d1-e1dff4257357 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:21:31 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7b475acb-1119-4eed-a7d1-e1dff4257357 Jul 10 18:21:31 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:21:31 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Jul 10 18:21:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ad649f06-a10f-4669-bd28-d7ae1738e646 tempest-AttachVolumeNegativeTest-1182710662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7b475acb-1119-4eed-a7d1-e1dff4257357" returned: 0 in 0.761s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:21:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ad649f06-a10f-4669-bd28-d7ae1738e646 tempest-AttachVolumeNegativeTest-1182710662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7b475acb-1119-4eed-a7d1-e1dff4257357 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:21:31 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7b475acb-1119-4eed-a7d1-e1dff4257357 Jul 10 18:21:31 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:21:32 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Jul 10 18:21:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ad649f06-a10f-4669-bd28-d7ae1738e646 tempest-AttachVolumeNegativeTest-1182710662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7b475acb-1119-4eed-a7d1-e1dff4257357" returned: 0 in 0.666s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:21:32 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ad649f06-a10f-4669-bd28-d7ae1738e646 tempest-AttachVolumeNegativeTest-1182710662 None] Lock "cinder-quobyte-7b475acb-1119-4eed-a7d1-e1dff4257357" released by "delete_volume" :: held 1.469s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:21:32 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-ad649f06-a10f-4669-bd28-d7ae1738e646 tempest-AttachVolumeNegativeTest-1182710662 None] Created reservations ['984b3b02-c172-4010-bbea-9a37500d454d', '6676ad0c-e9ec-4004-8710-64699b62f911', '5df36c00-db03-4380-87fd-256b4d6d16a9', 'a92c4993-16f5-47f5-89ba-53fd8c2da031'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:21:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ad649f06-a10f-4669-bd28-d7ae1738e646 tempest-AttachVolumeNegativeTest-1182710662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:21:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ad649f06-a10f-4669-bd28-d7ae1738e646 tempest-AttachVolumeNegativeTest-1182710662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:21:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ad649f06-a10f-4669-bd28-d7ae1738e646 tempest-AttachVolumeNegativeTest-1182710662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:21:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ad649f06-a10f-4669-bd28-d7ae1738e646 tempest-AttachVolumeNegativeTest-1182710662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:21:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ad649f06-a10f-4669-bd28-d7ae1738e646 tempest-AttachVolumeNegativeTest-1182710662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:21:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ad649f06-a10f-4669-bd28-d7ae1738e646 tempest-AttachVolumeNegativeTest-1182710662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:21:32 devstack sudo[101747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:21:32 devstack sudo[101747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:21:33 devstack sudo[101747]: pam_unix(sudo:session): session closed for user root Jul 10 18:21:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ad649f06-a10f-4669-bd28-d7ae1738e646 tempest-AttachVolumeNegativeTest-1182710662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.648s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:21:33 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-ad649f06-a10f-4669-bd28-d7ae1738e646 tempest-AttachVolumeNegativeTest-1182710662 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:21:33 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-ad649f06-a10f-4669-bd28-d7ae1738e646 tempest-AttachVolumeNegativeTest-1182710662 None] Deleted volume successfully. Jul 10 18:21:33 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ad649f06-a10f-4669-bd28-d7ae1738e646 tempest-AttachVolumeNegativeTest-1182710662 None] Lock "cinder-7b475acb-1119-4eed-a7d1-e1dff4257357-delete_volume" released by "delete_volume" :: held 2.331s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:21:33 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d1229246-7189-4aee-96c4-1751a416e2ea tempest-AttachVolumeNegativeTest-1182710662 None] Acquiring lock "cinder-db4a6fda-eab1-414d-bcbc-14cead251f34-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:21:33 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d1229246-7189-4aee-96c4-1751a416e2ea tempest-AttachVolumeNegativeTest-1182710662 None] Lock "cinder-db4a6fda-eab1-414d-bcbc-14cead251f34-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:21:33 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d1229246-7189-4aee-96c4-1751a416e2ea tempest-AttachVolumeNegativeTest-1182710662 None] Acquiring lock "cinder-quobyte-db4a6fda-eab1-414d-bcbc-14cead251f34" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:21:33 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d1229246-7189-4aee-96c4-1751a416e2ea tempest-AttachVolumeNegativeTest-1182710662 None] Lock "cinder-quobyte-db4a6fda-eab1-414d-bcbc-14cead251f34" acquired by "delete_volume" :: waited 0.013s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:21:33 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[773e1887-834a-4330-baf6-32dba105792c]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:21:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d1229246-7189-4aee-96c4-1751a416e2ea tempest-AttachVolumeNegativeTest-1182710662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db4a6fda-eab1-414d-bcbc-14cead251f34 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:21:33 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db4a6fda-eab1-414d-bcbc-14cead251f34 Jul 10 18:21:33 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:21:34 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Jul 10 18:21:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d1229246-7189-4aee-96c4-1751a416e2ea tempest-AttachVolumeNegativeTest-1182710662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db4a6fda-eab1-414d-bcbc-14cead251f34" returned: 0 in 0.752s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:21:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d1229246-7189-4aee-96c4-1751a416e2ea tempest-AttachVolumeNegativeTest-1182710662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db4a6fda-eab1-414d-bcbc-14cead251f34 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:21:34 devstack sudo[101755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db4a6fda-eab1-414d-bcbc-14cead251f34 Jul 10 18:21:34 devstack sudo[101755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:21:35 devstack sudo[101755]: pam_unix(sudo:session): session closed for user root Jul 10 18:21:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d1229246-7189-4aee-96c4-1751a416e2ea tempest-AttachVolumeNegativeTest-1182710662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db4a6fda-eab1-414d-bcbc-14cead251f34" returned: 0 in 0.655s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:21:35 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d1229246-7189-4aee-96c4-1751a416e2ea tempest-AttachVolumeNegativeTest-1182710662 None] Lock "cinder-quobyte-db4a6fda-eab1-414d-bcbc-14cead251f34" released by "delete_volume" :: held 1.445s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:21:35 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-d1229246-7189-4aee-96c4-1751a416e2ea tempest-AttachVolumeNegativeTest-1182710662 None] Created reservations ['7c82f4a8-18cf-4d5f-b403-57102e0514d4', '8ac7612c-a27a-4421-b85d-ec9ae76f118b', 'e1748055-f2c1-4693-b5dc-f2020445a046', 'bc810b69-3b16-4736-bec5-cf6734c9019c'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:21:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d1229246-7189-4aee-96c4-1751a416e2ea tempest-AttachVolumeNegativeTest-1182710662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:21:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d1229246-7189-4aee-96c4-1751a416e2ea tempest-AttachVolumeNegativeTest-1182710662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:21:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d1229246-7189-4aee-96c4-1751a416e2ea tempest-AttachVolumeNegativeTest-1182710662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:21:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d1229246-7189-4aee-96c4-1751a416e2ea tempest-AttachVolumeNegativeTest-1182710662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:21:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d1229246-7189-4aee-96c4-1751a416e2ea tempest-AttachVolumeNegativeTest-1182710662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:21:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d1229246-7189-4aee-96c4-1751a416e2ea tempest-AttachVolumeNegativeTest-1182710662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:21:35 devstack sudo[101758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:21:35 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:21:35 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root Jul 10 18:21:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d1229246-7189-4aee-96c4-1751a416e2ea tempest-AttachVolumeNegativeTest-1182710662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.659s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:21:35 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-d1229246-7189-4aee-96c4-1751a416e2ea tempest-AttachVolumeNegativeTest-1182710662 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:21:36 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-d1229246-7189-4aee-96c4-1751a416e2ea tempest-AttachVolumeNegativeTest-1182710662 None] Deleted volume successfully. Jul 10 18:21:36 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d1229246-7189-4aee-96c4-1751a416e2ea tempest-AttachVolumeNegativeTest-1182710662 None] Lock "cinder-db4a6fda-eab1-414d-bcbc-14cead251f34-delete_volume" released by "delete_volume" :: held 2.288s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:21:45 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=14,cinder:INSERT=5,cinder:UPDATE=20,cinder:DELETE=2 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:21:45 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-6496612e-69d4-4845-b652-81dcd21652c0 tempest-GroupSnapshotsTest-39858750 None] Group tempest-GroupSnapshotsTest-Group-1548084717: creating Jul 10 18:21:45 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-6496612e-69d4-4845-b652-81dcd21652c0 tempest-GroupSnapshotsTest-39858750 None] Group tempest-GroupSnapshotsTest-Group-1548084717: created successfully Jul 10 18:21:45 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-6496612e-69d4-4845-b652-81dcd21652c0 tempest-GroupSnapshotsTest-39858750 None] Create group completed successfully. Jul 10 18:21:47 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:21:47 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] Flow 'volume_create_manager' (4cf2516e-3009-4404-9ba2-c31479cd5f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:21:47 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30ff60f6-89dd-4420-8cd3-656e7beb3b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:21:47 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30ff60f6-89dd-4420-8cd3-656e7beb3b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1809354486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd15102e-e2ab-47f8-aa45-7513044c03a1,host='devstack@QuobyteHD#QuobyteHD',id=63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84bdd19ac3d459ca48090d20719fda3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:21:47Z,use_quota=True,user_id='1f81d00495814770abaaa0444cc3c03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5bb8fa9-cdc4-48bf-a982-e8c456853d32),volume_type_id=e5bb8fa9-cdc4-48bf-a982-e8c456853d32)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:21:47 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e31d985b-5401-474c-b38f-e7648c90da0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:21:47 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e31d985b-5401-474c-b38f-e7648c90da0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:21:47 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08d0c4f-95c4-41ec-be6c-3ec0ef9e0559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:21:47 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08d0c4f-95c4-41ec-be6c-3ec0ef9e0559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c', 'volume_name': 'volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:21:47 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3bf5376-7087-4c41-ae49-9da25b3cc543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:21:47 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3bf5376-7087-4c41-ae49-9da25b3cc543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:21:47 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4130d9c-cc1b-4eb4-9b70-7bab8bf8d93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:21:47 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] Volume 63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c', 'volume_size': 1} Jul 10 18:21:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:21:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:21:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bd15102e-e2ab-47f8-aa45-7513044c03a1,created_at=2026-07-10T16:21:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1809354486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd15102e-e2ab-47f8-aa45-7513044c03a1,host='devstack@QuobyteHD#QuobyteHD',id=63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84bdd19ac3d459ca48090d20719fda3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:21:47Z,use_quota=True,user_id='1f81d00495814770abaaa0444cc3c03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5bb8fa9-cdc4-48bf-a982-e8c456853d32),volume_type_id=e5bb8fa9-cdc4-48bf-a982-e8c456853d32)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:21:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] Creating volume 63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:21:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:21:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:21:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:21:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:21:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:21:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:21:47 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:21:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:21:47 devstack sudo[101767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c 1073741824 Jul 10 18:21:47 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:21:48 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root Jul 10 18:21:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c 1073741824" returned: 0 in 0.817s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:21:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:21:48 devstack sudo[101806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c Jul 10 18:21:48 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:21:48 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root Jul 10 18:21:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c" returned: 0 in 0.665s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:21:48 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:21:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:21:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4130d9c-cc1b-4eb4-9b70-7bab8bf8d93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:21:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed7df3c-5100-45e4-89cc-3e25129969be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:21:48 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] Volume volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c (63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c): created successfully Jul 10 18:21:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aed7df3c-5100-45e4-89cc-3e25129969be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:21:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] Flow 'volume_create_manager' (4cf2516e-3009-4404-9ba2-c31479cd5f14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:21:48 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-f04185d7-63e3-4bf7-a66a-557ea1c3aa07 tempest-GroupSnapshotsTest-39858750 None] Created volume successfully. Jul 10 18:21:49 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-1bc7e8e9-b795-4954-a6c8-462101eb9dc3 tempest-GroupSnapshotsTest-39858750 None] GroupSnapshot 198bbbc2-7e5d-494d-a290-be7c6eae85b0: creating. Jul 10 18:21:49 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1bc7e8e9-b795-4954-a6c8-462101eb9dc3 tempest-GroupSnapshotsTest-39858750 None] Group snapshot 198bbbc2-7e5d-494d-a290-be7c6eae85b0: creating. {{(pid=87399) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 18:21:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1bc7e8e9-b795-4954-a6c8-462101eb9dc3 tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:21:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1bc7e8e9-b795-4954-a6c8-462101eb9dc3 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:21:49 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-1bc7e8e9-b795-4954-a6c8-462101eb9dc3 tempest-GroupSnapshotsTest-39858750 None] Creating offline snapshot b68ad1b3-c6e4-440e-b6c7-55bd7730d1d0 of volume 63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:21:49 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fb92b8-d0f7-4294-a009-bf581c0f50ee]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:21:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1bc7e8e9-b795-4954-a6c8-462101eb9dc3 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:21:49 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c Jul 10 18:21:49 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:21:50 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Jul 10 18:21:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1bc7e8e9-b795-4954-a6c8-462101eb9dc3 tempest-GroupSnapshotsTest-39858750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c" returned: 0 in 0.756s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:21:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1bc7e8e9-b795-4954-a6c8-462101eb9dc3 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c.b68ad1b3-c6e4-440e-b6c7-55bd7730d1d0 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:21:50 devstack sudo[101816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c.b68ad1b3-c6e4-440e-b6c7-55bd7730d1d0 1G Jul 10 18:21:50 devstack sudo[101816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:21:51 devstack sudo[101816]: pam_unix(sudo:session): session closed for user root Jul 10 18:21:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1bc7e8e9-b795-4954-a6c8-462101eb9dc3 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c.b68ad1b3-c6e4-440e-b6c7-55bd7730d1d0 1G" returned: 0 in 0.801s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:21:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1bc7e8e9-b795-4954-a6c8-462101eb9dc3 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c.b68ad1b3-c6e4-440e-b6c7-55bd7730d1d0 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:21:51 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c.b68ad1b3-c6e4-440e-b6c7-55bd7730d1d0 Jul 10 18:21:51 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:21:51 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Jul 10 18:21:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1bc7e8e9-b795-4954-a6c8-462101eb9dc3 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c.b68ad1b3-c6e4-440e-b6c7-55bd7730d1d0" returned: 0 in 0.673s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:21:52 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-1bc7e8e9-b795-4954-a6c8-462101eb9dc3 tempest-GroupSnapshotsTest-39858750 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c.b68ad1b3-c6e4-440e-b6c7-55bd7730d1d0 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 18:21:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1bc7e8e9-b795-4954-a6c8-462101eb9dc3 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c.b68ad1b3-c6e4-440e-b6c7-55bd7730d1d0 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:21:52 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c.b68ad1b3-c6e4-440e-b6c7-55bd7730d1d0 Jul 10 18:21:52 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:21:52 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Jul 10 18:21:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1bc7e8e9-b795-4954-a6c8-462101eb9dc3 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c.b68ad1b3-c6e4-440e-b6c7-55bd7730d1d0" returned: 0 in 0.652s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:21:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1bc7e8e9-b795-4954-a6c8-462101eb9dc3 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:21:52 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c.info Jul 10 18:21:52 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:21:53 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Jul 10 18:21:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1bc7e8e9-b795-4954-a6c8-462101eb9dc3 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c.info" returned: 0 in 0.660s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:21:53 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-1bc7e8e9-b795-4954-a6c8-462101eb9dc3 tempest-GroupSnapshotsTest-39858750 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 18:21:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1bc7e8e9-b795-4954-a6c8-462101eb9dc3 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:21:53 devstack sudo[101834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c.info Jul 10 18:21:53 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:21:53 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root Jul 10 18:21:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1bc7e8e9-b795-4954-a6c8-462101eb9dc3 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c.info" returned: 0 in 0.641s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:21:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1bc7e8e9-b795-4954-a6c8-462101eb9dc3 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.262s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:21:54 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-1bc7e8e9-b795-4954-a6c8-462101eb9dc3 tempest-GroupSnapshotsTest-39858750 None] group_snapshot 198bbbc2-7e5d-494d-a290-be7c6eae85b0: created successfully Jul 10 18:21:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:21:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:21:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "cinder-quobyte-b68ad1b3-c6e4-440e-b6c7-55bd7730d1d0-602ee661-010a-47b2-86f6-984261413969" by "_create_volume_from_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:21:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] Lock "cinder-quobyte-b68ad1b3-c6e4-440e-b6c7-55bd7730d1d0-602ee661-010a-47b2-86f6-984261413969" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:21:55 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] Creating volume 602ee661-010a-47b2-86f6-984261413969 from snapshot b68ad1b3-c6e4-440e-b6c7-55bd7730d1d0 {{(pid=87399) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 18:21:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:21:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:21:55 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:21:55 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:21:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:21:55 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:21:56 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "cinder-quobyte-602ee661-010a-47b2-86f6-984261413969" by "_copy_volume_from_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:21:56 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] Lock "cinder-quobyte-602ee661-010a-47b2-86f6-984261413969" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:21:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] snapshot: b68ad1b3-c6e4-440e-b6c7-55bd7730d1d0, volume: 602ee661-010a-47b2-86f6-984261413969, {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 18:21:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:21:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:21:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:21:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:21:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:21:56 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c689da-fec0-4e2a-abae-b8e10d6616d0]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:21:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c.b68ad1b3-c6e4-440e-b6c7-55bd7730d1d0 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:21:56 devstack sudo[101840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c.b68ad1b3-c6e4-440e-b6c7-55bd7730d1d0 Jul 10 18:21:56 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:21:56 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root Jul 10 18:21:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c.b68ad1b3-c6e4-440e-b6c7-55bd7730d1d0" returned: 0 in 0.758s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:21:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:21:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] will copy from snapshot at /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 18:21:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] Creating direct copy from snapshot {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 18:21:56 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[466cba38-6a70-4bda-b233-693cb72f6c6c]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:21:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:21:56 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c Jul 10 18:21:56 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:21:57 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:21:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:21:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:21:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:21:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:21:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:21:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:21:57 devstack sudo[101850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:21:57 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:21:57 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Jul 10 18:21:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c" returned: 0 in 0.765s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:21:57 devstack cinder-volume[87399]: DEBUG cinder.utils [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] Path /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-602ee661-010a-47b2-86f6-984261413969 not found in is_blk_device check {{(pid=87399) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 18:21:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-602ee661-010a-47b2-86f6-984261413969 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:21:57 devstack sudo[101852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-602ee661-010a-47b2-86f6-984261413969 Jul 10 18:21:57 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:21:58 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root Jul 10 18:21:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.665s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:21:58 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:21:58 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager._thread_info {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:21:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread count: 28 {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 18:21:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread info: [<_MainThread(MainThread, started 139757428633728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 18:22:02 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-602ee661-010a-47b2-86f6-984261413969" returned: 0 in 4.733s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:02 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ab964d-6a52-4fe3-8779-07754a0c5da2]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:22:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:02 devstack sudo[101871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c Jul 10 18:22:02 devstack sudo[101871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:03 devstack sudo[101871]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c" returned: 0 in 0.909s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:03 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] Image conversion details: src /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c, size 1024.00 MB, duration 4.73 sec, destination /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-602ee661-010a-47b2-86f6-984261413969 {{(pid=87399) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 18:22:03 devstack cinder-volume[87399]: INFO cinder.image.image_utils [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] Converted 1024.00 MB image at 216.29 MB/s Jul 10 18:22:03 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-602ee661-010a-47b2-86f6-984261413969 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 18:22:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-602ee661-010a-47b2-86f6-984261413969 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:03 devstack sudo[101876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-602ee661-010a-47b2-86f6-984261413969 Jul 10 18:22:03 devstack sudo[101876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:03 devstack sudo[101876]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-602ee661-010a-47b2-86f6-984261413969" returned: 0 in 0.645s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:03 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] Lock "cinder-quobyte-602ee661-010a-47b2-86f6-984261413969" released by "_copy_volume_from_snapshot" :: held 7.914s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:22:03 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] Lock "cinder-quobyte-b68ad1b3-c6e4-440e-b6c7-55bd7730d1d0-602ee661-010a-47b2-86f6-984261413969" released by "_create_volume_from_snapshot" :: held 7.943s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:22:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.960s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:22:04 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-32770190-fbc9-468a-9da7-3167f03b5f34 tempest-GroupSnapshotsTest-39858750 None] Create group from source-snapshot-198bbbc2-7e5d-494d-a290-be7c6eae85b0 completed successfully. Jul 10 18:22:05 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b6ba6d3e-3cf9-4a85-bddc-e076bcf440eb tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "cinder-quobyte-602ee661-010a-47b2-86f6-984261413969" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:22:05 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b6ba6d3e-3cf9-4a85-bddc-e076bcf440eb tempest-GroupSnapshotsTest-39858750 None] Lock "cinder-quobyte-602ee661-010a-47b2-86f6-984261413969" acquired by "delete_volume" :: waited 0.020s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:22:05 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d84573f-c60b-49f1-af52-e13495d70ad1]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:22:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ba6d3e-3cf9-4a85-bddc-e076bcf440eb tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-602ee661-010a-47b2-86f6-984261413969 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:05 devstack sudo[101879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-602ee661-010a-47b2-86f6-984261413969 Jul 10 18:22:05 devstack sudo[101879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:06 devstack sudo[101879]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ba6d3e-3cf9-4a85-bddc-e076bcf440eb tempest-GroupSnapshotsTest-39858750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-602ee661-010a-47b2-86f6-984261413969" returned: 0 in 0.770s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ba6d3e-3cf9-4a85-bddc-e076bcf440eb tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-602ee661-010a-47b2-86f6-984261413969 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:06 devstack sudo[101886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-602ee661-010a-47b2-86f6-984261413969 Jul 10 18:22:06 devstack sudo[101886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:06 devstack sudo[101886]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ba6d3e-3cf9-4a85-bddc-e076bcf440eb tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-602ee661-010a-47b2-86f6-984261413969" returned: 0 in 0.643s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:06 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b6ba6d3e-3cf9-4a85-bddc-e076bcf440eb tempest-GroupSnapshotsTest-39858750 None] Lock "cinder-quobyte-602ee661-010a-47b2-86f6-984261413969" released by "delete_volume" :: held 1.457s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:22:06 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-b6ba6d3e-3cf9-4a85-bddc-e076bcf440eb tempest-GroupSnapshotsTest-39858750 None] Created reservations ['5e416275-5ffb-452b-9ce8-161f08c6e5e7'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:22:06 devstack cinder-volume[87399]: WARNING cinder.quota [None req-b6ba6d3e-3cf9-4a85-bddc-e076bcf440eb tempest-GroupSnapshotsTest-39858750 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1975292031 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1975292031, it is now deprecated. Please use the default quota class for default quota. Jul 10 18:22:06 devstack cinder-volume[87399]: WARNING cinder.quota [None req-b6ba6d3e-3cf9-4a85-bddc-e076bcf440eb tempest-GroupSnapshotsTest-39858750 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1975292031 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1975292031, it is now deprecated. Please use the default quota class for default quota. Jul 10 18:22:06 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-b6ba6d3e-3cf9-4a85-bddc-e076bcf440eb tempest-GroupSnapshotsTest-39858750 None] Created reservations ['53d62cff-9245-4354-b71e-008fdeb38255', '9fc4d932-856b-4913-bdf0-ced749e8da7e', 'e0adc1ed-6bba-4759-a150-e14a1e36688f', 'f75042ea-0b8f-4405-a4f3-8066ac947b77'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:22:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b6ba6d3e-3cf9-4a85-bddc-e076bcf440eb tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:22:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b6ba6d3e-3cf9-4a85-bddc-e076bcf440eb tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:22:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b6ba6d3e-3cf9-4a85-bddc-e076bcf440eb tempest-GroupSnapshotsTest-39858750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:22:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b6ba6d3e-3cf9-4a85-bddc-e076bcf440eb tempest-GroupSnapshotsTest-39858750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:22:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b6ba6d3e-3cf9-4a85-bddc-e076bcf440eb tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:22:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ba6d3e-3cf9-4a85-bddc-e076bcf440eb tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:06 devstack sudo[101889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:22:06 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:07 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b6ba6d3e-3cf9-4a85-bddc-e076bcf440eb tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.643s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:07 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-b6ba6d3e-3cf9-4a85-bddc-e076bcf440eb tempest-GroupSnapshotsTest-39858750 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:22:07 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-b6ba6d3e-3cf9-4a85-bddc-e076bcf440eb tempest-GroupSnapshotsTest-39858750 None] Delete group completed successfully. Jul 10 18:22:07 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-319fe25c-18ad-4e44-8aa9-be4a2874e07b tempest-GroupSnapshotsTest-39858750 None] group_snapshot 198bbbc2-7e5d-494d-a290-be7c6eae85b0: deleting Jul 10 18:22:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-319fe25c-18ad-4e44-8aa9-be4a2874e07b tempest-GroupSnapshotsTest-39858750 None] group_snapshot 198bbbc2-7e5d-494d-a290-be7c6eae85b0: deleting {{(pid=87399) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 18:22:07 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-319fe25c-18ad-4e44-8aa9-be4a2874e07b tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "cinder-quobyte-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:22:07 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-319fe25c-18ad-4e44-8aa9-be4a2874e07b tempest-GroupSnapshotsTest-39858750 None] Lock "cinder-quobyte-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:22:07 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-319fe25c-18ad-4e44-8aa9-be4a2874e07b tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "cinder-quobyte-b68ad1b3-c6e4-440e-b6c7-55bd7730d1d0" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:22:07 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-319fe25c-18ad-4e44-8aa9-be4a2874e07b tempest-GroupSnapshotsTest-39858750 None] Lock "cinder-quobyte-b68ad1b3-c6e4-440e-b6c7-55bd7730d1d0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:22:07 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-319fe25c-18ad-4e44-8aa9-be4a2874e07b tempest-GroupSnapshotsTest-39858750 None] Deleting offline snapshot b68ad1b3-c6e4-440e-b6c7-55bd7730d1d0 of volume 63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:22:07 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-319fe25c-18ad-4e44-8aa9-be4a2874e07b tempest-GroupSnapshotsTest-39858750 None] snapshot_file for this snap is: volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c.b68ad1b3-c6e4-440e-b6c7-55bd7730d1d0 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:22:07 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff44b304-880e-4b7d-8b24-a0f297ae40c6]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:22:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-319fe25c-18ad-4e44-8aa9-be4a2874e07b tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c.b68ad1b3-c6e4-440e-b6c7-55bd7730d1d0 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:07 devstack sudo[101892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c.b68ad1b3-c6e4-440e-b6c7-55bd7730d1d0 Jul 10 18:22:07 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:08 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-319fe25c-18ad-4e44-8aa9-be4a2874e07b tempest-GroupSnapshotsTest-39858750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c.b68ad1b3-c6e4-440e-b6c7-55bd7730d1d0" returned: 0 in 0.771s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-319fe25c-18ad-4e44-8aa9-be4a2874e07b tempest-GroupSnapshotsTest-39858750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:22:08 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72ba585-6ea2-48b4-a840-ed8bf7f9a12e]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:22:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-319fe25c-18ad-4e44-8aa9-be4a2874e07b tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:08 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c Jul 10 18:22:08 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:09 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-319fe25c-18ad-4e44-8aa9-be4a2874e07b tempest-GroupSnapshotsTest-39858750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c" returned: 0 in 0.762s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-319fe25c-18ad-4e44-8aa9-be4a2874e07b tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c.b68ad1b3-c6e4-440e-b6c7-55bd7730d1d0 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:09 devstack sudo[101902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c.b68ad1b3-c6e4-440e-b6c7-55bd7730d1d0 Jul 10 18:22:09 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:10 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-319fe25c-18ad-4e44-8aa9-be4a2874e07b tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c.b68ad1b3-c6e4-440e-b6c7-55bd7730d1d0" returned: 0 in 0.734s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-319fe25c-18ad-4e44-8aa9-be4a2874e07b tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c.b68ad1b3-c6e4-440e-b6c7-55bd7730d1d0 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:10 devstack sudo[101907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c.b68ad1b3-c6e4-440e-b6c7-55bd7730d1d0 Jul 10 18:22:10 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:10 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-319fe25c-18ad-4e44-8aa9-be4a2874e07b tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c.b68ad1b3-c6e4-440e-b6c7-55bd7730d1d0" returned: 0 in 0.666s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:10 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-319fe25c-18ad-4e44-8aa9-be4a2874e07b tempest-GroupSnapshotsTest-39858750 None] Lock "cinder-quobyte-b68ad1b3-c6e4-440e-b6c7-55bd7730d1d0" released by "_delete_snapshot" :: held 3.030s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:22:10 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-319fe25c-18ad-4e44-8aa9-be4a2874e07b tempest-GroupSnapshotsTest-39858750 None] Lock "cinder-quobyte-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c" released by "delete_snapshot" :: held 3.051s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:22:10 devstack cinder-volume[87399]: WARNING cinder.quota [None req-319fe25c-18ad-4e44-8aa9-be4a2874e07b tempest-GroupSnapshotsTest-39858750 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1975292031 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1975292031, it is now deprecated. Please use the default quota class for default quota. Jul 10 18:22:10 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-319fe25c-18ad-4e44-8aa9-be4a2874e07b tempest-GroupSnapshotsTest-39858750 None] Created reservations ['a90b4c2e-7306-4a25-a9b5-28d67e4fd363', 'd12202b7-6b58-403e-bc04-8fa31e5b916b', '4e22d4a0-95f7-4d0a-89a5-85aae4a05928', '25467fa9-02de-4196-8f03-4ad5ac3463ec'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:22:10 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-319fe25c-18ad-4e44-8aa9-be4a2874e07b tempest-GroupSnapshotsTest-39858750 None] group_snapshot 198bbbc2-7e5d-494d-a290-be7c6eae85b0: deleted successfully Jul 10 18:22:11 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-58d8bef7-815c-4976-9c19-fe37bf107650 tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "cinder-quobyte-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:22:11 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-58d8bef7-815c-4976-9c19-fe37bf107650 tempest-GroupSnapshotsTest-39858750 None] Lock "cinder-quobyte-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c" acquired by "delete_volume" :: waited 0.015s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:22:11 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[33851e53-f304-4e43-ad7f-038add98cca7]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:22:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-58d8bef7-815c-4976-9c19-fe37bf107650 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:11 devstack sudo[101910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c Jul 10 18:22:11 devstack sudo[101910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:12 devstack sudo[101910]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-58d8bef7-815c-4976-9c19-fe37bf107650 tempest-GroupSnapshotsTest-39858750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c" returned: 0 in 0.774s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-58d8bef7-815c-4976-9c19-fe37bf107650 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:12 devstack sudo[101915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c Jul 10 18:22:12 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:12 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-58d8bef7-815c-4976-9c19-fe37bf107650 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c" returned: 0 in 0.650s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-58d8bef7-815c-4976-9c19-fe37bf107650 tempest-GroupSnapshotsTest-39858750 None] Lock "cinder-quobyte-63738c48-3d6b-4d9e-8bf1-b7ba7ce4766c" released by "delete_volume" :: held 1.488s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:22:12 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-58d8bef7-815c-4976-9c19-fe37bf107650 tempest-GroupSnapshotsTest-39858750 None] Created reservations ['a35db576-f0e8-4e5a-b0df-eb5c653a32e7'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:22:12 devstack cinder-volume[87399]: WARNING cinder.db.api [None req-58d8bef7-815c-4976-9c19-fe37bf107650 tempest-GroupSnapshotsTest-39858750 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1975292031'] Jul 10 18:22:12 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-58d8bef7-815c-4976-9c19-fe37bf107650 tempest-GroupSnapshotsTest-39858750 None] Created reservations ['8d3876c1-2c2b-45b1-a369-faeb5255fb09', '371145ce-08e7-4f61-8fb4-c3df57822da5', '62c736b9-6ae8-405e-99f8-2e4f7c215916', 'c97ada58-cb28-4f91-9863-f716de3e8221'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:22:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-58d8bef7-815c-4976-9c19-fe37bf107650 tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:22:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-58d8bef7-815c-4976-9c19-fe37bf107650 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:22:12 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-58d8bef7-815c-4976-9c19-fe37bf107650 tempest-GroupSnapshotsTest-39858750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:22:12 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-58d8bef7-815c-4976-9c19-fe37bf107650 tempest-GroupSnapshotsTest-39858750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:22:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-58d8bef7-815c-4976-9c19-fe37bf107650 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:22:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-58d8bef7-815c-4976-9c19-fe37bf107650 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:12 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:22:12 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:13 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-58d8bef7-815c-4976-9c19-fe37bf107650 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.643s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:13 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-58d8bef7-815c-4976-9c19-fe37bf107650 tempest-GroupSnapshotsTest-39858750 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:22:13 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-58d8bef7-815c-4976-9c19-fe37bf107650 tempest-GroupSnapshotsTest-39858750 None] Delete group completed successfully. Jul 10 18:22:13 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-24c0a87f-ee80-407a-8929-03aecdcb614e tempest-GroupSnapshotsTest-39858750 None] Group tempest-GroupSnapshotsTest-Group-1750719356: creating Jul 10 18:22:13 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-24c0a87f-ee80-407a-8929-03aecdcb614e tempest-GroupSnapshotsTest-39858750 None] Group tempest-GroupSnapshotsTest-Group-1750719356: created successfully Jul 10 18:22:13 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-24c0a87f-ee80-407a-8929-03aecdcb614e tempest-GroupSnapshotsTest-39858750 None] Create group completed successfully. Jul 10 18:22:15 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:22:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] Flow 'volume_create_manager' (5bb099b4-42d3-4c0a-828e-06d10f559b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:22:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d3f1ee-21e8-490b-a275-4920ecc46a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:22:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d3f1ee-21e8-490b-a275-4920ecc46a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1958751717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=72a50dbe-50e3-4d1e-ad3e-ee9873ee6c45,host='devstack@QuobyteHD#QuobyteHD',id=b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84bdd19ac3d459ca48090d20719fda3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:22:15Z,use_quota=True,user_id='1f81d00495814770abaaa0444cc3c03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b17b71d5-654b-4d47-b95a-ab94b413c250),volume_type_id=b17b71d5-654b-4d47-b95a-ab94b413c250)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:22:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8bc3c1-e727-4064-8f0f-ce37bb1ba037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:22:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8bc3c1-e727-4064-8f0f-ce37bb1ba037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:22:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c467292-191d-45cd-8336-46eead97ce7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:22:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c467292-191d-45cd-8336-46eead97ce7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd', 'volume_name': 'volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:22:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06967f0b-f2a4-405e-86a8-49ce5f41a96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:22:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06967f0b-f2a4-405e-86a8-49ce5f41a96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:22:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d652a74-80c0-4e95-98e2-9ded475e1abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:22:15 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] Volume b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd', 'volume_size': 1} Jul 10 18:22:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:22:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:22:15 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=72a50dbe-50e3-4d1e-ad3e-ee9873ee6c45,created_at=2026-07-10T16:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1958751717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=72a50dbe-50e3-4d1e-ad3e-ee9873ee6c45,host='devstack@QuobyteHD#QuobyteHD',id=b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84bdd19ac3d459ca48090d20719fda3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:22:15Z,use_quota=True,user_id='1f81d00495814770abaaa0444cc3c03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b17b71d5-654b-4d47-b95a-ab94b413c250),volume_type_id=b17b71d5-654b-4d47-b95a-ab94b413c250)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:22:15 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] Creating volume b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:22:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:22:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:22:15 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:22:15 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:22:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:22:15 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:22:15 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:22:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:15 devstack sudo[101921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd 1073741824 Jul 10 18:22:15 devstack sudo[101921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:16 devstack sudo[101921]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd 1073741824" returned: 0 in 0.813s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:16 devstack sudo[101927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd Jul 10 18:22:16 devstack sudo[101927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:17 devstack sudo[101927]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd" returned: 0 in 0.655s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:22:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:22:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d652a74-80c0-4e95-98e2-9ded475e1abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:22:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff40fd8-7b13-4c64-b137-2fdb1e5132f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:22:17 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] Volume volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd (b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd): created successfully Jul 10 18:22:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff40fd8-7b13-4c64-b137-2fdb1e5132f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:22:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] Flow 'volume_create_manager' (5bb099b4-42d3-4c0a-828e-06d10f559b9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:22:17 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-e8a39f29-91b6-4e53-bd86-5f3771a75243 tempest-GroupSnapshotsTest-39858750 None] Created volume successfully. Jul 10 18:22:18 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:22:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] Flow 'volume_create_manager' (37222a11-7223-4426-9e0e-3e20fff3f1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:22:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b97db23-d893-4948-aa3c-16bf66078bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:22:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b97db23-d893-4948-aa3c-16bf66078bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-306185530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=72a50dbe-50e3-4d1e-ad3e-ee9873ee6c45,host='devstack@QuobyteHD#QuobyteHD',id=ba953175-21ce-4aba-8d4f-751cd3dd6a36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84bdd19ac3d459ca48090d20719fda3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:22:18Z,use_quota=True,user_id='1f81d00495814770abaaa0444cc3c03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b17b71d5-654b-4d47-b95a-ab94b413c250),volume_type_id=b17b71d5-654b-4d47-b95a-ab94b413c250)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:22:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0061de2-905c-4f83-a32a-c111afbbe852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:22:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0061de2-905c-4f83-a32a-c111afbbe852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:22:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c152247b-d0d6-46ff-9c52-f4a12d6826e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:22:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c152247b-d0d6-46ff-9c52-f4a12d6826e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba953175-21ce-4aba-8d4f-751cd3dd6a36', 'volume_name': 'volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:22:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1c9682-ee4a-4a91-ab7d-a07e68de5e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:22:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c1c9682-ee4a-4a91-ab7d-a07e68de5e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:22:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b962d59-c9cb-4a29-b484-2c614939214e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:22:18 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] Volume ba953175-21ce-4aba-8d4f-751cd3dd6a36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36', 'volume_size': 1} Jul 10 18:22:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:22:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:22:18 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=72a50dbe-50e3-4d1e-ad3e-ee9873ee6c45,created_at=2026-07-10T16:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-306185530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=72a50dbe-50e3-4d1e-ad3e-ee9873ee6c45,host='devstack@QuobyteHD#QuobyteHD',id=ba953175-21ce-4aba-8d4f-751cd3dd6a36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84bdd19ac3d459ca48090d20719fda3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:22:18Z,use_quota=True,user_id='1f81d00495814770abaaa0444cc3c03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b17b71d5-654b-4d47-b95a-ab94b413c250),volume_type_id=b17b71d5-654b-4d47-b95a-ab94b413c250)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:22:18 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] Creating volume ba953175-21ce-4aba-8d4f-751cd3dd6a36 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:22:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:22:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:22:18 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:22:18 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:22:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:22:18 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:22:18 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:22:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:18 devstack sudo[101930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36 1073741824 Jul 10 18:22:18 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:19 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36 1073741824" returned: 0 in 0.796s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:19 devstack sudo[101935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36 Jul 10 18:22:19 devstack sudo[101935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:19 devstack sudo[101935]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36" returned: 0 in 0.661s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:19 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:22:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:22:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b962d59-c9cb-4a29-b484-2c614939214e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:22:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46dd7d81-a2b7-409c-b989-676f1be0fec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:22:19 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] Volume volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36 (ba953175-21ce-4aba-8d4f-751cd3dd6a36): created successfully Jul 10 18:22:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46dd7d81-a2b7-409c-b989-676f1be0fec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:22:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] Flow 'volume_create_manager' (37222a11-7223-4426-9e0e-3e20fff3f1a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:22:19 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-fd8e36b6-7c00-4e08-a16f-913bb98e79b9 tempest-GroupSnapshotsTest-39858750 None] Created volume successfully. Jul 10 18:22:20 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-a55c594c-92dd-4f02-8420-fe25b9ff3f19 tempest-GroupSnapshotsTest-39858750 None] Update group completed successfully. Jul 10 18:22:21 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-be88a801-2e89-4242-a5e3-c5f6db2b43b8 tempest-GroupSnapshotsTest-39858750 None] Update group completed successfully. Jul 10 18:22:23 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-8247163f-5f5c-4fca-b2ad-2ef57f11a002 tempest-GroupSnapshotsTest-39858750 None] Update group completed successfully. Jul 10 18:22:24 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-ab43fa0c-a0fc-4e8d-8c6e-4591600b3798 tempest-GroupSnapshotsTest-39858750 None] Update group completed successfully. Jul 10 18:22:25 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] GroupSnapshot e031b5a1-0fba-4fc3-bb9d-87a479b663fb: creating. Jul 10 18:22:25 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] Group snapshot e031b5a1-0fba-4fc3-bb9d-87a479b663fb: creating. {{(pid=87399) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 18:22:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:22:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:22:25 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] Creating offline snapshot d896efb9-5f41-48ab-8813-fe0b223fda58 of volume ba953175-21ce-4aba-8d4f-751cd3dd6a36 {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:22:25 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[42738697-3fee-412c-979a-a4326c354c6b]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:22:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:25 devstack sudo[101939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36 Jul 10 18:22:25 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:26 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36" returned: 0 in 0.763s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36.d896efb9-5f41-48ab-8813-fe0b223fda58 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:26 devstack sudo[101945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36.d896efb9-5f41-48ab-8813-fe0b223fda58 1G Jul 10 18:22:26 devstack sudo[101945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:27 devstack sudo[101945]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36.d896efb9-5f41-48ab-8813-fe0b223fda58 1G" returned: 0 in 0.798s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36.d896efb9-5f41-48ab-8813-fe0b223fda58 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:27 devstack sudo[101950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36.d896efb9-5f41-48ab-8813-fe0b223fda58 Jul 10 18:22:27 devstack sudo[101950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:28 devstack sudo[101950]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36.d896efb9-5f41-48ab-8813-fe0b223fda58" returned: 0 in 0.699s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:28 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36.d896efb9-5f41-48ab-8813-fe0b223fda58 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 18:22:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36.d896efb9-5f41-48ab-8813-fe0b223fda58 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:28 devstack sudo[101955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36.d896efb9-5f41-48ab-8813-fe0b223fda58 Jul 10 18:22:28 devstack sudo[101955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:28 devstack sudo[101955]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36.d896efb9-5f41-48ab-8813-fe0b223fda58" returned: 0 in 0.632s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:28 devstack sudo[101958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36.info Jul 10 18:22:28 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:29 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36.info" returned: 0 in 0.670s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:29 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 18:22:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:29 devstack sudo[101961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36.info Jul 10 18:22:29 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:30 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36.info" returned: 0 in 0.644s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.286s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:22:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:22:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:22:30 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] Creating offline snapshot edd2e0ee-c752-4224-a747-d143143e05d6 of volume b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:22:30 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[5018226c-e841-4bc0-a010-c94abe2b64d8]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:22:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:30 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd Jul 10 18:22:30 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:30 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd" returned: 0 in 0.763s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd.edd2e0ee-c752-4224-a747-d143143e05d6 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:30 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd.edd2e0ee-c752-4224-a747-d143143e05d6 1G Jul 10 18:22:30 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:31 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd.edd2e0ee-c752-4224-a747-d143143e05d6 1G" returned: 0 in 0.831s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd.edd2e0ee-c752-4224-a747-d143143e05d6 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:31 devstack sudo[101975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd.edd2e0ee-c752-4224-a747-d143143e05d6 Jul 10 18:22:31 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:32 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd.edd2e0ee-c752-4224-a747-d143143e05d6" returned: 0 in 0.718s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:32 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd.edd2e0ee-c752-4224-a747-d143143e05d6 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 18:22:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd.edd2e0ee-c752-4224-a747-d143143e05d6 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:32 devstack sudo[101980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd.edd2e0ee-c752-4224-a747-d143143e05d6 Jul 10 18:22:32 devstack sudo[101980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:33 devstack sudo[101980]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd.edd2e0ee-c752-4224-a747-d143143e05d6" returned: 0 in 0.663s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:33 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=71,cinder:INSERT=17,cinder:UPDATE=76,cinder:DELETE=2 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:22:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:33 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd.info Jul 10 18:22:33 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:33 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd.info" returned: 0 in 0.647s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:33 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 18:22:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:33 devstack sudo[101986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd.info Jul 10 18:22:33 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:34 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd.info" returned: 0 in 0.645s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.359s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:22:34 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-f2dc2386-0f23-4e7a-8018-69daa096d8c7 tempest-GroupSnapshotsTest-39858750 None] group_snapshot e031b5a1-0fba-4fc3-bb9d-87a479b663fb: created successfully Jul 10 18:22:35 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] group_snapshot e031b5a1-0fba-4fc3-bb9d-87a479b663fb: deleting Jul 10 18:22:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] group_snapshot e031b5a1-0fba-4fc3-bb9d-87a479b663fb: deleting {{(pid=87399) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 18:22:35 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "cinder-quobyte-ba953175-21ce-4aba-8d4f-751cd3dd6a36" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:22:35 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] Lock "cinder-quobyte-ba953175-21ce-4aba-8d4f-751cd3dd6a36" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:22:35 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "cinder-quobyte-d896efb9-5f41-48ab-8813-fe0b223fda58" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:22:35 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] Lock "cinder-quobyte-d896efb9-5f41-48ab-8813-fe0b223fda58" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:22:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] Deleting offline snapshot d896efb9-5f41-48ab-8813-fe0b223fda58 of volume ba953175-21ce-4aba-8d4f-751cd3dd6a36 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:22:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] snapshot_file for this snap is: volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36.d896efb9-5f41-48ab-8813-fe0b223fda58 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:22:35 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60dae16-e031-44b0-9533-e18ac9e2e008]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:22:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36.d896efb9-5f41-48ab-8813-fe0b223fda58 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:35 devstack sudo[101989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36.d896efb9-5f41-48ab-8813-fe0b223fda58 Jul 10 18:22:35 devstack sudo[101989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:36 devstack sudo[101989]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36.d896efb9-5f41-48ab-8813-fe0b223fda58" returned: 0 in 0.765s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:22:36 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[abcfa322-dadc-4487-b51c-d8f379fef169]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:22:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:36 devstack sudo[101995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36 Jul 10 18:22:36 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:36 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36" returned: 0 in 0.769s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36.d896efb9-5f41-48ab-8813-fe0b223fda58 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:36 devstack sudo[102000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36.d896efb9-5f41-48ab-8813-fe0b223fda58 Jul 10 18:22:36 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:37 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36.d896efb9-5f41-48ab-8813-fe0b223fda58" returned: 0 in 0.755s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36.d896efb9-5f41-48ab-8813-fe0b223fda58 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:37 devstack sudo[102005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36.d896efb9-5f41-48ab-8813-fe0b223fda58 Jul 10 18:22:37 devstack sudo[102005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:38 devstack sudo[102005]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36.d896efb9-5f41-48ab-8813-fe0b223fda58" returned: 0 in 0.639s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:38 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] Lock "cinder-quobyte-d896efb9-5f41-48ab-8813-fe0b223fda58" released by "_delete_snapshot" :: held 3.021s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:22:38 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] Lock "cinder-quobyte-ba953175-21ce-4aba-8d4f-751cd3dd6a36" released by "delete_snapshot" :: held 3.043s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:22:38 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "cinder-quobyte-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:22:38 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] Lock "cinder-quobyte-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:22:38 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "cinder-quobyte-edd2e0ee-c752-4224-a747-d143143e05d6" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:22:38 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] Lock "cinder-quobyte-edd2e0ee-c752-4224-a747-d143143e05d6" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:22:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] Deleting offline snapshot edd2e0ee-c752-4224-a747-d143143e05d6 of volume b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:22:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] snapshot_file for this snap is: volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd.edd2e0ee-c752-4224-a747-d143143e05d6 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:22:38 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[b760229d-dce5-43ee-8cd5-daf4a319fa13]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:22:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd.edd2e0ee-c752-4224-a747-d143143e05d6 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:38 devstack sudo[102008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd.edd2e0ee-c752-4224-a747-d143143e05d6 Jul 10 18:22:38 devstack sudo[102008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:39 devstack sudo[102008]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd.edd2e0ee-c752-4224-a747-d143143e05d6" returned: 0 in 0.760s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:39 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:22:39 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba67445-1e3a-45b6-a8eb-edbda92ba483]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:22:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:39 devstack sudo[102013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd Jul 10 18:22:39 devstack sudo[102013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:40 devstack sudo[102013]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd" returned: 0 in 0.797s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd.edd2e0ee-c752-4224-a747-d143143e05d6 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:40 devstack sudo[102018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd.edd2e0ee-c752-4224-a747-d143143e05d6 Jul 10 18:22:40 devstack sudo[102018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:40 devstack sudo[102018]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd.edd2e0ee-c752-4224-a747-d143143e05d6" returned: 0 in 0.729s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd.edd2e0ee-c752-4224-a747-d143143e05d6 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:40 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd.edd2e0ee-c752-4224-a747-d143143e05d6 Jul 10 18:22:40 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:41 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd.edd2e0ee-c752-4224-a747-d143143e05d6" returned: 0 in 0.674s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:41 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] Lock "cinder-quobyte-edd2e0ee-c752-4224-a747-d143143e05d6" released by "_delete_snapshot" :: held 3.048s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:22:41 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] Lock "cinder-quobyte-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd" released by "delete_snapshot" :: held 3.068s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:22:41 devstack cinder-volume[87399]: WARNING cinder.quota [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-800813985 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-800813985, it is now deprecated. Please use the default quota class for default quota. Jul 10 18:22:41 devstack cinder-volume[87399]: WARNING cinder.quota [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-800813985 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-800813985, it is now deprecated. Please use the default quota class for default quota. Jul 10 18:22:41 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] Created reservations ['2cd50a28-290b-4b0a-b832-2b9ca0c7f32a', '57cc3e47-ccbc-491a-820e-4056e953bf16', '4cfee9c6-f968-4284-9df2-d129a741eefd', 'df55be8c-0e8a-4540-8947-117fbb89dfaa'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:22:41 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] Created reservations ['c245a916-592c-44dd-a54c-65616e306c5e', 'f1dbccd8-e516-4f43-9f3a-9e4521524432', '5c6bd581-d1d2-47e2-8075-41dfb2de7c42', '759df4dd-8127-4fa3-bbb7-4944a78c93e3'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:22:41 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-d60a6f8d-2cf3-4935-b2eb-c55921ab816f tempest-GroupSnapshotsTest-39858750 None] group_snapshot e031b5a1-0fba-4fc3-bb9d-87a479b663fb: deleted successfully Jul 10 18:22:42 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cc7da001-1cfb-40ec-a7b4-3b74b0f75de1 tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "cinder-quobyte-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:22:42 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cc7da001-1cfb-40ec-a7b4-3b74b0f75de1 tempest-GroupSnapshotsTest-39858750 None] Lock "cinder-quobyte-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd" acquired by "delete_volume" :: waited 0.016s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:22:42 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[76af71af-8f90-4364-bba8-aeb909e343c3]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:22:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cc7da001-1cfb-40ec-a7b4-3b74b0f75de1 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:42 devstack sudo[102026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd Jul 10 18:22:42 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:42 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cc7da001-1cfb-40ec-a7b4-3b74b0f75de1 tempest-GroupSnapshotsTest-39858750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd" returned: 0 in 0.767s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cc7da001-1cfb-40ec-a7b4-3b74b0f75de1 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:42 devstack sudo[102031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd Jul 10 18:22:42 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:43 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cc7da001-1cfb-40ec-a7b4-3b74b0f75de1 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd" returned: 0 in 0.675s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:43 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cc7da001-1cfb-40ec-a7b4-3b74b0f75de1 tempest-GroupSnapshotsTest-39858750 None] Lock "cinder-quobyte-b2c1a889-fa5f-47d5-b3b7-6abe5bc010cd" released by "delete_volume" :: held 1.499s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:22:43 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cc7da001-1cfb-40ec-a7b4-3b74b0f75de1 tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "cinder-quobyte-ba953175-21ce-4aba-8d4f-751cd3dd6a36" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:22:43 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cc7da001-1cfb-40ec-a7b4-3b74b0f75de1 tempest-GroupSnapshotsTest-39858750 None] Lock "cinder-quobyte-ba953175-21ce-4aba-8d4f-751cd3dd6a36" acquired by "delete_volume" :: waited 0.014s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:22:43 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6203883-47f1-4eb7-968d-29aa3c638fa9]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:22:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cc7da001-1cfb-40ec-a7b4-3b74b0f75de1 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:43 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36 Jul 10 18:22:43 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:44 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cc7da001-1cfb-40ec-a7b4-3b74b0f75de1 tempest-GroupSnapshotsTest-39858750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36" returned: 0 in 0.753s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cc7da001-1cfb-40ec-a7b4-3b74b0f75de1 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:44 devstack sudo[102039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36 Jul 10 18:22:44 devstack sudo[102039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:45 devstack sudo[102039]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cc7da001-1cfb-40ec-a7b4-3b74b0f75de1 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ba953175-21ce-4aba-8d4f-751cd3dd6a36" returned: 0 in 0.638s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:45 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cc7da001-1cfb-40ec-a7b4-3b74b0f75de1 tempest-GroupSnapshotsTest-39858750 None] Lock "cinder-quobyte-ba953175-21ce-4aba-8d4f-751cd3dd6a36" released by "delete_volume" :: held 1.448s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:22:45 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-cc7da001-1cfb-40ec-a7b4-3b74b0f75de1 tempest-GroupSnapshotsTest-39858750 None] Created reservations ['0799ef0c-b5f7-47a2-91c0-1048ac6a0eee'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:22:45 devstack cinder-volume[87399]: WARNING cinder.quota [None req-cc7da001-1cfb-40ec-a7b4-3b74b0f75de1 tempest-GroupSnapshotsTest-39858750 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-800813985 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-800813985, it is now deprecated. Please use the default quota class for default quota. Jul 10 18:22:45 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-cc7da001-1cfb-40ec-a7b4-3b74b0f75de1 tempest-GroupSnapshotsTest-39858750 None] Created reservations ['54c12d62-1149-42f8-801e-415c09abe6a5', 'b750f67f-bdbd-42aa-8e0d-7e30ae9345a6', '20ae0fd6-388b-47c0-be43-30066f221dee', 'cce5e92a-2d79-4289-82a4-b018b3b3cd15'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:22:45 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-cc7da001-1cfb-40ec-a7b4-3b74b0f75de1 tempest-GroupSnapshotsTest-39858750 None] Created reservations ['d2b767e4-cfea-4bc9-b26d-c2cd5c6fd04c', '63bafe38-49fa-42c9-ba2c-9a89a061ca28', '922a0d04-1cef-46ca-b66c-328afcde339a', '181036cc-0dec-4ce9-b629-798ea5758db4'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:22:45 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=79,cinder:UPDATE=70,cinder:INSERT=19,cinder:DELETE=2 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:22:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-cc7da001-1cfb-40ec-a7b4-3b74b0f75de1 tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:22:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-cc7da001-1cfb-40ec-a7b4-3b74b0f75de1 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:22:45 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-cc7da001-1cfb-40ec-a7b4-3b74b0f75de1 tempest-GroupSnapshotsTest-39858750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:22:45 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-cc7da001-1cfb-40ec-a7b4-3b74b0f75de1 tempest-GroupSnapshotsTest-39858750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:22:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-cc7da001-1cfb-40ec-a7b4-3b74b0f75de1 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:22:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cc7da001-1cfb-40ec-a7b4-3b74b0f75de1 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:45 devstack sudo[102042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:22:45 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:46 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-5e73792f-415b-44e6-91ed-5a15b364c207 tempest-GroupSnapshotsTest-39858750 None] Group tempest-GroupSnapshotsTest-Group-408698387: creating Jul 10 18:22:46 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-5e73792f-415b-44e6-91ed-5a15b364c207 tempest-GroupSnapshotsTest-39858750 None] Group tempest-GroupSnapshotsTest-Group-408698387: created successfully Jul 10 18:22:46 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-5e73792f-415b-44e6-91ed-5a15b364c207 tempest-GroupSnapshotsTest-39858750 None] Create group completed successfully. Jul 10 18:22:46 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cc7da001-1cfb-40ec-a7b4-3b74b0f75de1 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.694s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:46 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-cc7da001-1cfb-40ec-a7b4-3b74b0f75de1 tempest-GroupSnapshotsTest-39858750 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:22:46 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-cc7da001-1cfb-40ec-a7b4-3b74b0f75de1 tempest-GroupSnapshotsTest-39858750 None] Delete group completed successfully. Jul 10 18:22:47 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:22:47 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] Flow 'volume_create_manager' (a9803d7c-6d55-47da-95d6-2ffb79597c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:22:47 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb019293-8092-435b-8996-d1170b798d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:22:47 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb019293-8092-435b-8996-d1170b798d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-486087356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b798ee1a-c989-449e-924a-1447a78d2f02,host='devstack@QuobyteHD#QuobyteHD',id=669bd1fe-a1b2-41ba-ba11-247bdc7e9db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84bdd19ac3d459ca48090d20719fda3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:22:48Z,use_quota=True,user_id='1f81d00495814770abaaa0444cc3c03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(365736e3-cefe-4c57-a56c-f4669c881bc8),volume_type_id=365736e3-cefe-4c57-a56c-f4669c881bc8)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:22:47 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b7fb49-48cf-46ba-8284-d1ca9a412433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:22:47 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88b7fb49-48cf-46ba-8284-d1ca9a412433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:22:47 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c0bf3b-b82b-40a0-8e02-9ba8220ee2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:22:47 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c0bf3b-b82b-40a0-8e02-9ba8220ee2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '669bd1fe-a1b2-41ba-ba11-247bdc7e9db3', 'volume_name': 'volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:22:47 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f85c7be-8f4d-4a26-a7b4-737a2c6bb585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:22:47 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f85c7be-8f4d-4a26-a7b4-737a2c6bb585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:22:47 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d44d9d5e-bdef-4662-ae77-2a7b123ae8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:22:47 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] Volume 669bd1fe-a1b2-41ba-ba11-247bdc7e9db3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3', 'volume_size': 1} Jul 10 18:22:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:22:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:22:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b798ee1a-c989-449e-924a-1447a78d2f02,created_at=2026-07-10T16:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-486087356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b798ee1a-c989-449e-924a-1447a78d2f02,host='devstack@QuobyteHD#QuobyteHD',id=669bd1fe-a1b2-41ba-ba11-247bdc7e9db3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b84bdd19ac3d459ca48090d20719fda3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:22:48Z,use_quota=True,user_id='1f81d00495814770abaaa0444cc3c03f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(365736e3-cefe-4c57-a56c-f4669c881bc8),volume_type_id=365736e3-cefe-4c57-a56c-f4669c881bc8)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:22:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] Creating volume 669bd1fe-a1b2-41ba-ba11-247bdc7e9db3 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:22:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:22:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:22:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:22:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:22:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:22:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:22:47 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:22:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:47 devstack sudo[102046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3 1073741824 Jul 10 18:22:47 devstack sudo[102046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:48 devstack sudo[102046]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3 1073741824" returned: 0 in 0.889s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:48 devstack sudo[102087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3 Jul 10 18:22:48 devstack sudo[102087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:49 devstack sudo[102087]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3" returned: 0 in 0.648s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:49 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:22:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:22:49 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d44d9d5e-bdef-4662-ae77-2a7b123ae8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:22:49 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5159c57-a4cf-4ddc-8637-d7d3afc38e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:22:49 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] Volume volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3 (669bd1fe-a1b2-41ba-ba11-247bdc7e9db3): created successfully Jul 10 18:22:49 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5159c57-a4cf-4ddc-8637-d7d3afc38e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:22:49 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] Flow 'volume_create_manager' (a9803d7c-6d55-47da-95d6-2ffb79597c2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:22:49 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-1c99eff2-565d-4b99-984b-b31c40f44033 tempest-GroupSnapshotsTest-39858750 None] Created volume successfully. Jul 10 18:22:50 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-b44d59ec-377b-4c93-b6b6-a0bb0e5c47e9 tempest-GroupSnapshotsTest-39858750 None] GroupSnapshot 97a8bceb-dc1f-42ea-84d7-97aba0e56ffd: creating. Jul 10 18:22:50 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b44d59ec-377b-4c93-b6b6-a0bb0e5c47e9 tempest-GroupSnapshotsTest-39858750 None] Group snapshot 97a8bceb-dc1f-42ea-84d7-97aba0e56ffd: creating. {{(pid=87399) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 18:22:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b44d59ec-377b-4c93-b6b6-a0bb0e5c47e9 tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:22:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b44d59ec-377b-4c93-b6b6-a0bb0e5c47e9 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:22:50 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-b44d59ec-377b-4c93-b6b6-a0bb0e5c47e9 tempest-GroupSnapshotsTest-39858750 None] Creating offline snapshot 7fbf82ba-1fe8-4b14-be4d-f96e006fd977 of volume 669bd1fe-a1b2-41ba-ba11-247bdc7e9db3 {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:22:50 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f4be9b-a72b-46d3-bb77-45065314a610]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:22:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b44d59ec-377b-4c93-b6b6-a0bb0e5c47e9 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:50 devstack sudo[102090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3 Jul 10 18:22:50 devstack sudo[102090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:50 devstack sudo[102090]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b44d59ec-377b-4c93-b6b6-a0bb0e5c47e9 tempest-GroupSnapshotsTest-39858750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3" returned: 0 in 0.770s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b44d59ec-377b-4c93-b6b6-a0bb0e5c47e9 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3.7fbf82ba-1fe8-4b14-be4d-f96e006fd977 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:51 devstack sudo[102095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3.7fbf82ba-1fe8-4b14-be4d-f96e006fd977 1G Jul 10 18:22:51 devstack sudo[102095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:51 devstack sudo[102095]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b44d59ec-377b-4c93-b6b6-a0bb0e5c47e9 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3.7fbf82ba-1fe8-4b14-be4d-f96e006fd977 1G" returned: 0 in 0.782s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b44d59ec-377b-4c93-b6b6-a0bb0e5c47e9 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3.7fbf82ba-1fe8-4b14-be4d-f96e006fd977 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:51 devstack sudo[102100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3.7fbf82ba-1fe8-4b14-be4d-f96e006fd977 Jul 10 18:22:51 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:52 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b44d59ec-377b-4c93-b6b6-a0bb0e5c47e9 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3.7fbf82ba-1fe8-4b14-be4d-f96e006fd977" returned: 0 in 0.724s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:52 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-b44d59ec-377b-4c93-b6b6-a0bb0e5c47e9 tempest-GroupSnapshotsTest-39858750 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3.7fbf82ba-1fe8-4b14-be4d-f96e006fd977 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 18:22:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b44d59ec-377b-4c93-b6b6-a0bb0e5c47e9 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3.7fbf82ba-1fe8-4b14-be4d-f96e006fd977 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:52 devstack sudo[102107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3.7fbf82ba-1fe8-4b14-be4d-f96e006fd977 Jul 10 18:22:52 devstack sudo[102107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:53 devstack sudo[102107]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b44d59ec-377b-4c93-b6b6-a0bb0e5c47e9 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3.7fbf82ba-1fe8-4b14-be4d-f96e006fd977" returned: 0 in 0.634s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b44d59ec-377b-4c93-b6b6-a0bb0e5c47e9 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:53 devstack sudo[102110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3.info Jul 10 18:22:53 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:53 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b44d59ec-377b-4c93-b6b6-a0bb0e5c47e9 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3.info" returned: 0 in 0.663s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:53 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-b44d59ec-377b-4c93-b6b6-a0bb0e5c47e9 tempest-GroupSnapshotsTest-39858750 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 18:22:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b44d59ec-377b-4c93-b6b6-a0bb0e5c47e9 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:53 devstack sudo[102113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3.info Jul 10 18:22:53 devstack sudo[102113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:54 devstack sudo[102113]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b44d59ec-377b-4c93-b6b6-a0bb0e5c47e9 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3.info" returned: 0 in 0.658s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b44d59ec-377b-4c93-b6b6-a0bb0e5c47e9 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.309s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:22:54 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-b44d59ec-377b-4c93-b6b6-a0bb0e5c47e9 tempest-GroupSnapshotsTest-39858750 None] group_snapshot 97a8bceb-dc1f-42ea-84d7-97aba0e56ffd: created successfully Jul 10 18:22:55 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-542fbfd3-aa32-4bbe-98f1-1301dcc90754 tempest-GroupSnapshotsTest-39858750 None] group_snapshot 97a8bceb-dc1f-42ea-84d7-97aba0e56ffd: deleting Jul 10 18:22:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-542fbfd3-aa32-4bbe-98f1-1301dcc90754 tempest-GroupSnapshotsTest-39858750 None] group_snapshot 97a8bceb-dc1f-42ea-84d7-97aba0e56ffd: deleting {{(pid=87399) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 18:22:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-542fbfd3-aa32-4bbe-98f1-1301dcc90754 tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "cinder-quobyte-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:22:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-542fbfd3-aa32-4bbe-98f1-1301dcc90754 tempest-GroupSnapshotsTest-39858750 None] Lock "cinder-quobyte-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:22:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-542fbfd3-aa32-4bbe-98f1-1301dcc90754 tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "cinder-quobyte-7fbf82ba-1fe8-4b14-be4d-f96e006fd977" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:22:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-542fbfd3-aa32-4bbe-98f1-1301dcc90754 tempest-GroupSnapshotsTest-39858750 None] Lock "cinder-quobyte-7fbf82ba-1fe8-4b14-be4d-f96e006fd977" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:22:55 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-542fbfd3-aa32-4bbe-98f1-1301dcc90754 tempest-GroupSnapshotsTest-39858750 None] Deleting offline snapshot 7fbf82ba-1fe8-4b14-be4d-f96e006fd977 of volume 669bd1fe-a1b2-41ba-ba11-247bdc7e9db3 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:22:55 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-542fbfd3-aa32-4bbe-98f1-1301dcc90754 tempest-GroupSnapshotsTest-39858750 None] snapshot_file for this snap is: volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3.7fbf82ba-1fe8-4b14-be4d-f96e006fd977 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:22:55 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[506958e5-4e48-4bf0-8a41-5365ccd7d44d]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:22:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-542fbfd3-aa32-4bbe-98f1-1301dcc90754 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3.7fbf82ba-1fe8-4b14-be4d-f96e006fd977 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:55 devstack sudo[102118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3.7fbf82ba-1fe8-4b14-be4d-f96e006fd977 Jul 10 18:22:55 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:56 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-542fbfd3-aa32-4bbe-98f1-1301dcc90754 tempest-GroupSnapshotsTest-39858750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3.7fbf82ba-1fe8-4b14-be4d-f96e006fd977" returned: 0 in 0.784s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-542fbfd3-aa32-4bbe-98f1-1301dcc90754 tempest-GroupSnapshotsTest-39858750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:22:56 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b15ba2-fa9e-4c7d-8123-eaf67d5c543a]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:22:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-542fbfd3-aa32-4bbe-98f1-1301dcc90754 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:56 devstack sudo[102124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3 Jul 10 18:22:56 devstack sudo[102124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:57 devstack sudo[102124]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-542fbfd3-aa32-4bbe-98f1-1301dcc90754 tempest-GroupSnapshotsTest-39858750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3" returned: 0 in 0.774s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-542fbfd3-aa32-4bbe-98f1-1301dcc90754 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3.7fbf82ba-1fe8-4b14-be4d-f96e006fd977 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:57 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3.7fbf82ba-1fe8-4b14-be4d-f96e006fd977 Jul 10 18:22:57 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:57 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:22:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:22:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:22:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:22:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:22:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:22:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:57 devstack sudo[102131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:22:57 devstack sudo[102131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:57 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-542fbfd3-aa32-4bbe-98f1-1301dcc90754 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3.7fbf82ba-1fe8-4b14-be4d-f96e006fd977" returned: 0 in 0.744s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-542fbfd3-aa32-4bbe-98f1-1301dcc90754 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3.7fbf82ba-1fe8-4b14-be4d-f96e006fd977 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:58 devstack sudo[102136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3.7fbf82ba-1fe8-4b14-be4d-f96e006fd977 Jul 10 18:22:58 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:58 devstack sudo[102131]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.683s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:58 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:22:58 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager._thread_info {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:22:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread count: 28 {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 18:22:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread info: [<_MainThread(MainThread, started 139757428633728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 18:22:58 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-542fbfd3-aa32-4bbe-98f1-1301dcc90754 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3.7fbf82ba-1fe8-4b14-be4d-f96e006fd977" returned: 0 in 0.674s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:58 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-542fbfd3-aa32-4bbe-98f1-1301dcc90754 tempest-GroupSnapshotsTest-39858750 None] Lock "cinder-quobyte-7fbf82ba-1fe8-4b14-be4d-f96e006fd977" released by "_delete_snapshot" :: held 3.067s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:22:58 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-542fbfd3-aa32-4bbe-98f1-1301dcc90754 tempest-GroupSnapshotsTest-39858750 None] Lock "cinder-quobyte-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3" released by "delete_snapshot" :: held 3.089s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:22:58 devstack cinder-volume[87399]: WARNING cinder.quota [None req-542fbfd3-aa32-4bbe-98f1-1301dcc90754 tempest-GroupSnapshotsTest-39858750 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-874133986 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-874133986, it is now deprecated. Please use the default quota class for default quota. Jul 10 18:22:58 devstack cinder-volume[87399]: WARNING cinder.quota [None req-542fbfd3-aa32-4bbe-98f1-1301dcc90754 tempest-GroupSnapshotsTest-39858750 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-874133986 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-874133986, it is now deprecated. Please use the default quota class for default quota. Jul 10 18:22:58 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-542fbfd3-aa32-4bbe-98f1-1301dcc90754 tempest-GroupSnapshotsTest-39858750 None] Created reservations ['48957cd4-cc34-4416-9b46-b06b49556b3f', '471e441d-37ca-4075-8b1e-eb2bbc1be567', '907e6be3-baaa-46fd-99d0-63762d3a01da', '65186ad6-f64c-4b59-9117-724812d00e3a'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:22:58 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-542fbfd3-aa32-4bbe-98f1-1301dcc90754 tempest-GroupSnapshotsTest-39858750 None] group_snapshot 97a8bceb-dc1f-42ea-84d7-97aba0e56ffd: deleted successfully Jul 10 18:22:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-65210e94-8cc6-4707-9041-c3fd687a7b55 tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "cinder-quobyte-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:22:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-65210e94-8cc6-4707-9041-c3fd687a7b55 tempest-GroupSnapshotsTest-39858750 None] Lock "cinder-quobyte-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3" acquired by "delete_volume" :: waited 0.016s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:22:59 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c98eaaf-3ab2-4c21-9aa6-291b5262a5f1]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:22:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-65210e94-8cc6-4707-9041-c3fd687a7b55 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:22:59 devstack sudo[102140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3 Jul 10 18:22:59 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:22:59 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root Jul 10 18:22:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-65210e94-8cc6-4707-9041-c3fd687a7b55 tempest-GroupSnapshotsTest-39858750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3" returned: 0 in 0.775s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:22:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-65210e94-8cc6-4707-9041-c3fd687a7b55 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:00 devstack sudo[102148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3 Jul 10 18:23:00 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:00 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-65210e94-8cc6-4707-9041-c3fd687a7b55 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3" returned: 0 in 0.659s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:00 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-65210e94-8cc6-4707-9041-c3fd687a7b55 tempest-GroupSnapshotsTest-39858750 None] Lock "cinder-quobyte-669bd1fe-a1b2-41ba-ba11-247bdc7e9db3" released by "delete_volume" :: held 1.503s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:23:00 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-65210e94-8cc6-4707-9041-c3fd687a7b55 tempest-GroupSnapshotsTest-39858750 None] Created reservations ['32d03d2b-c8fd-4821-9199-9a3f4fe681b5'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:23:00 devstack cinder-volume[87399]: WARNING cinder.quota [None req-65210e94-8cc6-4707-9041-c3fd687a7b55 tempest-GroupSnapshotsTest-39858750 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-874133986 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-874133986, it is now deprecated. Please use the default quota class for default quota. Jul 10 18:23:00 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-65210e94-8cc6-4707-9041-c3fd687a7b55 tempest-GroupSnapshotsTest-39858750 None] Created reservations ['f7c43e10-cc44-4f2b-b9b6-672eef699717', 'e727ac64-83ad-4a35-8bcb-6e0814f1cdb5', '1e1db6f5-c383-4e2e-8a85-8952a3d85306', 'adafccb7-ec13-4cd6-b2fa-1c7e6d06fa79'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:23:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-65210e94-8cc6-4707-9041-c3fd687a7b55 tempest-GroupSnapshotsTest-39858750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:23:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-65210e94-8cc6-4707-9041-c3fd687a7b55 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:23:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-65210e94-8cc6-4707-9041-c3fd687a7b55 tempest-GroupSnapshotsTest-39858750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:23:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-65210e94-8cc6-4707-9041-c3fd687a7b55 tempest-GroupSnapshotsTest-39858750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:23:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-65210e94-8cc6-4707-9041-c3fd687a7b55 tempest-GroupSnapshotsTest-39858750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:23:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-65210e94-8cc6-4707-9041-c3fd687a7b55 tempest-GroupSnapshotsTest-39858750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:00 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:23:00 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:01 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-65210e94-8cc6-4707-9041-c3fd687a7b55 tempest-GroupSnapshotsTest-39858750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.658s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:01 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-65210e94-8cc6-4707-9041-c3fd687a7b55 tempest-GroupSnapshotsTest-39858750 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:23:01 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-65210e94-8cc6-4707-9041-c3fd687a7b55 tempest-GroupSnapshotsTest-39858750 None] Delete group completed successfully. Jul 10 18:23:10 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=55,cinder:UPDATE=64,cinder:INSERT=13,cinder:DELETE=1 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:23:10 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:UPDATE=23,cinder:SELECT=27,cinder:INSERT=6 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:23:14 devstack cinder-volume[87399]: DEBUG cinder.coordination [req-d04fb0a8-a737-4671-aa2f-97b606077cbb req-051281f6-a46f-4525-8088-efd981e067b4 tempest-TestShelveInstance-1977941275 None] Acquiring lock "cinder-f0e1a3d9-dc7e-406f-b246-f535bf020702-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:23:14 devstack cinder-volume[87399]: DEBUG cinder.coordination [req-d04fb0a8-a737-4671-aa2f-97b606077cbb req-051281f6-a46f-4525-8088-efd981e067b4 tempest-TestShelveInstance-1977941275 None] Lock "cinder-f0e1a3d9-dc7e-406f-b246-f535bf020702-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:23:14 devstack cinder-volume[87399]: DEBUG cinder.coordination [req-d04fb0a8-a737-4671-aa2f-97b606077cbb req-051281f6-a46f-4525-8088-efd981e067b4 tempest-TestShelveInstance-1977941275 None] Acquiring lock "cinder-quobyte-f0e1a3d9-dc7e-406f-b246-f535bf020702" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:23:14 devstack cinder-volume[87399]: DEBUG cinder.coordination [req-d04fb0a8-a737-4671-aa2f-97b606077cbb req-051281f6-a46f-4525-8088-efd981e067b4 tempest-TestShelveInstance-1977941275 None] Lock "cinder-quobyte-f0e1a3d9-dc7e-406f-b246-f535bf020702" acquired by "delete_volume" :: waited 0.016s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:23:14 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[b828f4c7-7f3f-4a7e-8732-8a5d7e15e8dc]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:23:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-d04fb0a8-a737-4671-aa2f-97b606077cbb req-051281f6-a46f-4525-8088-efd981e067b4 tempest-TestShelveInstance-1977941275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:14 devstack sudo[102162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702 Jul 10 18:23:14 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:15 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-d04fb0a8-a737-4671-aa2f-97b606077cbb req-051281f6-a46f-4525-8088-efd981e067b4 tempest-TestShelveInstance-1977941275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702" returned: 0 in 0.823s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-d04fb0a8-a737-4671-aa2f-97b606077cbb req-051281f6-a46f-4525-8088-efd981e067b4 tempest-TestShelveInstance-1977941275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:15 devstack sudo[102166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702 Jul 10 18:23:15 devstack sudo[102166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:16 devstack sudo[102166]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-d04fb0a8-a737-4671-aa2f-97b606077cbb req-051281f6-a46f-4525-8088-efd981e067b4 tempest-TestShelveInstance-1977941275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702" returned: 1 in 0.854s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-d04fb0a8-a737-4671-aa2f-97b606077cbb req-051281f6-a46f-4525-8088-efd981e067b4 tempest-TestShelveInstance-1977941275 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:23:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-d04fb0a8-a737-4671-aa2f-97b606077cbb req-051281f6-a46f-4525-8088-efd981e067b4 tempest-TestShelveInstance-1977941275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:16 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702 Jul 10 18:23:16 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:17 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-d04fb0a8-a737-4671-aa2f-97b606077cbb req-051281f6-a46f-4525-8088-efd981e067b4 tempest-TestShelveInstance-1977941275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f0e1a3d9-dc7e-406f-b246-f535bf020702" returned: 0 in 0.684s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:17 devstack cinder-volume[87399]: DEBUG cinder.coordination [req-d04fb0a8-a737-4671-aa2f-97b606077cbb req-051281f6-a46f-4525-8088-efd981e067b4 tempest-TestShelveInstance-1977941275 None] Lock "cinder-quobyte-f0e1a3d9-dc7e-406f-b246-f535bf020702" released by "delete_volume" :: held 2.465s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:23:17 devstack cinder-volume[87399]: DEBUG cinder.quota [req-d04fb0a8-a737-4671-aa2f-97b606077cbb req-051281f6-a46f-4525-8088-efd981e067b4 tempest-TestShelveInstance-1977941275 None] Created reservations ['d3a51c32-fbc7-4b49-9abd-9c395354d2ec', '99be70a6-e9fb-4900-a8e9-5c11520c5529', '26550b26-9649-43bf-ab8d-3be67dbf5129', '0ed17625-b390-41c1-8039-818ee2ee6eeb'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:23:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-d04fb0a8-a737-4671-aa2f-97b606077cbb req-051281f6-a46f-4525-8088-efd981e067b4 tempest-TestShelveInstance-1977941275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:23:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-d04fb0a8-a737-4671-aa2f-97b606077cbb req-051281f6-a46f-4525-8088-efd981e067b4 tempest-TestShelveInstance-1977941275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:23:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [req-d04fb0a8-a737-4671-aa2f-97b606077cbb req-051281f6-a46f-4525-8088-efd981e067b4 tempest-TestShelveInstance-1977941275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:23:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [req-d04fb0a8-a737-4671-aa2f-97b606077cbb req-051281f6-a46f-4525-8088-efd981e067b4 tempest-TestShelveInstance-1977941275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:23:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-d04fb0a8-a737-4671-aa2f-97b606077cbb req-051281f6-a46f-4525-8088-efd981e067b4 tempest-TestShelveInstance-1977941275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:23:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-d04fb0a8-a737-4671-aa2f-97b606077cbb req-051281f6-a46f-4525-8088-efd981e067b4 tempest-TestShelveInstance-1977941275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:17 devstack sudo[102175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:23:17 devstack sudo[102175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:18 devstack sudo[102175]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-d04fb0a8-a737-4671-aa2f-97b606077cbb req-051281f6-a46f-4525-8088-efd981e067b4 tempest-TestShelveInstance-1977941275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.689s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:18 devstack cinder-volume[87399]: DEBUG cinder.manager [req-d04fb0a8-a737-4671-aa2f-97b606077cbb req-051281f6-a46f-4525-8088-efd981e067b4 tempest-TestShelveInstance-1977941275 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:23:18 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-d04fb0a8-a737-4671-aa2f-97b606077cbb req-051281f6-a46f-4525-8088-efd981e067b4 tempest-TestShelveInstance-1977941275 None] Deleted volume successfully. Jul 10 18:23:18 devstack cinder-volume[87399]: DEBUG cinder.coordination [req-d04fb0a8-a737-4671-aa2f-97b606077cbb req-051281f6-a46f-4525-8088-efd981e067b4 tempest-TestShelveInstance-1977941275 None] Lock "cinder-f0e1a3d9-dc7e-406f-b246-f535bf020702-delete_volume" released by "delete_volume" :: held 3.437s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:23:24 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:23:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] Flow 'volume_create_manager' (4d01aab1-d159-4e59-81c9-e2e09fb819b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:23:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6001ef45-284f-4c9f-aef3-01652f171503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6001ef45-284f-4c9f-aef3-01652f171503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-459491957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de3e1456-4731-431a-bbaa-63a67e313537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d81b32516a45e3b7c562f0b531190a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:23:24Z,use_quota=True,user_id='6a6f095e0763486b84cbc8b0b005fcdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f086e8cd-31a7-4f5c-85ce-c78d36ce5e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f086e8cd-31a7-4f5c-85ce-c78d36ce5e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d1a7f2-3766-4c1d-b8fa-42f5951d9909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d1a7f2-3766-4c1d-b8fa-42f5951d9909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de3e1456-4731-431a-bbaa-63a67e313537', 'volume_name': 'volume-de3e1456-4731-431a-bbaa-63a67e313537', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fbe39ea-6244-4b4c-825f-a7cf9b560247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fbe39ea-6244-4b4c-825f-a7cf9b560247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c13da1d0-39fe-47d1-a86a-728c5d9a4d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:24 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] Volume de3e1456-4731-431a-bbaa-63a67e313537: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de3e1456-4731-431a-bbaa-63a67e313537', 'volume_size': 1} Jul 10 18:23:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:23:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:23:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-459491957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de3e1456-4731-431a-bbaa-63a67e313537,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d81b32516a45e3b7c562f0b531190a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:23:24Z,use_quota=True,user_id='6a6f095e0763486b84cbc8b0b005fcdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:23:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] Creating volume de3e1456-4731-431a-bbaa-63a67e313537 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:23:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:23:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:23:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:23:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:23:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:23:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:23:24 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:23:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-de3e1456-4731-431a-bbaa-63a67e313537 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:24 devstack sudo[102184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-de3e1456-4731-431a-bbaa-63a67e313537 1073741824 Jul 10 18:23:24 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:25 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-de3e1456-4731-431a-bbaa-63a67e313537 1073741824" returned: 0 in 0.905s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-de3e1456-4731-431a-bbaa-63a67e313537 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:25 devstack sudo[102190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-de3e1456-4731-431a-bbaa-63a67e313537 Jul 10 18:23:25 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:26 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-de3e1456-4731-431a-bbaa-63a67e313537" returned: 0 in 0.666s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:26 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:23:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:23:26 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c13da1d0-39fe-47d1-a86a-728c5d9a4d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de3e1456-4731-431a-bbaa-63a67e313537', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:26 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (238da6d4-959f-43e7-9dd5-c0b5e6ea808b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:26 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] Volume volume-de3e1456-4731-431a-bbaa-63a67e313537 (de3e1456-4731-431a-bbaa-63a67e313537): created successfully Jul 10 18:23:26 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (238da6d4-959f-43e7-9dd5-c0b5e6ea808b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:26 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] Flow 'volume_create_manager' (4d01aab1-d159-4e59-81c9-e2e09fb819b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:23:26 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-444ea8e0-b4e1-47f6-9175-4ccdc66648fa tempest-VolumeQuotasAdminTestJSON-1304258423 None] Created volume successfully. Jul 10 18:23:26 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d8287f52-9f50-4760-9c51-f764c76a8742 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Acquiring lock "cinder-de3e1456-4731-431a-bbaa-63a67e313537-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:23:26 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d8287f52-9f50-4760-9c51-f764c76a8742 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Lock "cinder-de3e1456-4731-431a-bbaa-63a67e313537-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:23:26 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d8287f52-9f50-4760-9c51-f764c76a8742 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Acquiring lock "cinder-quobyte-de3e1456-4731-431a-bbaa-63a67e313537" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:23:26 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d8287f52-9f50-4760-9c51-f764c76a8742 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Lock "cinder-quobyte-de3e1456-4731-431a-bbaa-63a67e313537" acquired by "delete_volume" :: waited 0.021s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:23:26 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6476357-1ea2-40e8-9632-289a5178809c]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:23:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d8287f52-9f50-4760-9c51-f764c76a8742 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-de3e1456-4731-431a-bbaa-63a67e313537 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:26 devstack sudo[102194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-de3e1456-4731-431a-bbaa-63a67e313537 Jul 10 18:23:26 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:27 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d8287f52-9f50-4760-9c51-f764c76a8742 tempest-VolumeQuotasAdminTestJSON-1304258423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-de3e1456-4731-431a-bbaa-63a67e313537" returned: 0 in 0.777s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d8287f52-9f50-4760-9c51-f764c76a8742 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-de3e1456-4731-431a-bbaa-63a67e313537 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:27 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-de3e1456-4731-431a-bbaa-63a67e313537 Jul 10 18:23:27 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:27 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:23:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Flow 'volume_create_manager' (64c31d65-47a5-471d-b282-0d534f54ee6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:23:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01b5ebf0-f9ee-4332-9f30-9291c040898e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01b5ebf0-f9ee-4332-9f30-9291c040898e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-561691740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834ab53207b1466a8533b1b37b50fc51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:23:28Z,use_quota=True,user_id='8fbc02d95bed4db8a6057273a44f3875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb5cd82a-398b-40e1-86c2-c397848c1203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb5cd82a-398b-40e1-86c2-c397848c1203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb159ff0-c18f-414b-9830-f3dd3d3ebe13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb159ff0-c18f-414b-9830-f3dd3d3ebe13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e', 'volume_name': 'volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d4e9ed5-deb0-411e-be7d-1d06fb808e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d4e9ed5-deb0-411e-be7d-1d06fb808e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a7e475-2487-4e83-be30-6eccee5cfdda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:27 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Volume 09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e', 'volume_size': 1} Jul 10 18:23:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:23:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:23:27 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-561691740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834ab53207b1466a8533b1b37b50fc51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:23:28Z,use_quota=True,user_id='8fbc02d95bed4db8a6057273a44f3875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:23:27 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Creating volume 09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:23:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:23:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:23:27 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:23:27 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:23:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:23:27 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:23:27 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:23:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:27 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e 1073741824 Jul 10 18:23:27 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:27 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d8287f52-9f50-4760-9c51-f764c76a8742 tempest-VolumeQuotasAdminTestJSON-1304258423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-de3e1456-4731-431a-bbaa-63a67e313537" returned: 0 in 0.702s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:27 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d8287f52-9f50-4760-9c51-f764c76a8742 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Lock "cinder-quobyte-de3e1456-4731-431a-bbaa-63a67e313537" released by "delete_volume" :: held 1.518s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:23:27 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-d8287f52-9f50-4760-9c51-f764c76a8742 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Created reservations ['821a6329-a895-44d2-9248-0fb4915a0840', 'e1549060-3213-4557-89c1-f49651edaaae', '98146b8f-9b73-46d2-b9f2-6b2af719b5a5', '5bcb5686-df2f-4440-8506-b1cb2781db8b'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:23:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d8287f52-9f50-4760-9c51-f764c76a8742 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:23:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d8287f52-9f50-4760-9c51-f764c76a8742 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:23:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d8287f52-9f50-4760-9c51-f764c76a8742 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:23:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d8287f52-9f50-4760-9c51-f764c76a8742 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:23:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d8287f52-9f50-4760-9c51-f764c76a8742 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:23:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d8287f52-9f50-4760-9c51-f764c76a8742 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:28 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:23:28 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:28 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e 1073741824" returned: 0 in 0.911s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:28 devstack sudo[102214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e Jul 10 18:23:28 devstack sudo[102214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:28 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d8287f52-9f50-4760-9c51-f764c76a8742 tempest-VolumeQuotasAdminTestJSON-1304258423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.713s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:28 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-d8287f52-9f50-4760-9c51-f764c76a8742 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:23:28 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-d8287f52-9f50-4760-9c51-f764c76a8742 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Deleted volume successfully. Jul 10 18:23:28 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-d8287f52-9f50-4760-9c51-f764c76a8742 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Lock "cinder-de3e1456-4731-431a-bbaa-63a67e313537-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:23:29 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:23:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Flow 'volume_create_manager' (d90aa52e-8a42-4dbb-8c8a-747b4138112b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:23:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bccd96a9-789f-464d-9fca-28088f8adc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bccd96a9-789f-464d-9fca-28088f8adc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-586816153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f56f6a-b500-4506-924c-37b7e401ab9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d81b32516a45e3b7c562f0b531190a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:23:29Z,use_quota=True,user_id='6a6f095e0763486b84cbc8b0b005fcdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9de4e6d-9864-4534-b82c-f3031ef227f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9de4e6d-9864-4534-b82c-f3031ef227f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (436c13bc-a6f3-48e5-b065-da63627780a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (436c13bc-a6f3-48e5-b065-da63627780a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37f56f6a-b500-4506-924c-37b7e401ab9d', 'volume_name': 'volume-37f56f6a-b500-4506-924c-37b7e401ab9d', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c493fdd5-2de8-4e0d-b6fe-1635fe73ad5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c493fdd5-2de8-4e0d-b6fe-1635fe73ad5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cccb7e1-ff24-4be1-a158-f3e28d1eaae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:29 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Volume 37f56f6a-b500-4506-924c-37b7e401ab9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37f56f6a-b500-4506-924c-37b7e401ab9d', 'volume_size': 1} Jul 10 18:23:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:23:29 devstack sudo[102214]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e" returned: 0 in 0.691s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:23:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:23:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.204s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:23:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-586816153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f56f6a-b500-4506-924c-37b7e401ab9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d81b32516a45e3b7c562f0b531190a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:23:29Z,use_quota=True,user_id='6a6f095e0763486b84cbc8b0b005fcdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:23:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Creating volume 37f56f6a-b500-4506-924c-37b7e401ab9d {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:23:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:23:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:23:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:23:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:23:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:23:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:23:29 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:23:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-37f56f6a-b500-4506-924c-37b7e401ab9d 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a7e475-2487-4e83-be30-6eccee5cfdda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:29 devstack sudo[102217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-37f56f6a-b500-4506-924c-37b7e401ab9d 1073741824 Jul 10 18:23:29 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6417feae-5c72-4699-a12d-63ef646c7385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:29 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Volume volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e (09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e): created successfully Jul 10 18:23:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6417feae-5c72-4699-a12d-63ef646c7385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Flow 'volume_create_manager' (64c31d65-47a5-471d-b282-0d534f54ee6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:23:29 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-566b02b4-0640-40dd-989c-ea8bc416d0a7 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Created volume successfully. Jul 10 18:23:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-bb81aa3d-13bb-497d-8443-cdd04cb09910 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:23:30 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-37f56f6a-b500-4506-924c-37b7e401ab9d 1073741824" returned: 0 in 0.836s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-37f56f6a-b500-4506-924c-37b7e401ab9d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:30 devstack sudo[102223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-37f56f6a-b500-4506-924c-37b7e401ab9d Jul 10 18:23:30 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:30 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-37f56f6a-b500-4506-924c-37b7e401ab9d" returned: 0 in 0.651s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:30 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:23:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:23:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-bb81aa3d-13bb-497d-8443-cdd04cb09910 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.027s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:23:30 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cccb7e1-ff24-4be1-a158-f3e28d1eaae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37f56f6a-b500-4506-924c-37b7e401ab9d', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:30 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b72d0d-42bd-4c09-88e4-26c11552d079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:30 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-bb81aa3d-13bb-497d-8443-cdd04cb09910 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Creating offline snapshot ce81fd1d-59d3-4746-bf39-11fe5d7d772e of volume 09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:23:30 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Volume volume-37f56f6a-b500-4506-924c-37b7e401ab9d (37f56f6a-b500-4506-924c-37b7e401ab9d): created successfully Jul 10 18:23:30 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89b72d0d-42bd-4c09-88e4-26c11552d079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:30 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Flow 'volume_create_manager' (d90aa52e-8a42-4dbb-8c8a-747b4138112b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:23:30 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dabaab-67e5-43af-89ba-630963a7954f]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:23:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bb81aa3d-13bb-497d-8443-cdd04cb09910 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:31 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-8b68a22a-522b-47f9-b268-62f64cbf2894 tempest-VolumeQuotasAdminTestJSON-1304258423 None] Created volume successfully. Jul 10 18:23:31 devstack sudo[102226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e Jul 10 18:23:31 devstack sudo[102226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:31 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-ab44f316-8945-465e-881e-0d3c9bd5b706 tempest-VolumeQuotasAdminTestJSON-1259002832 None] Transfer volume completed successfully. Jul 10 18:23:31 devstack sudo[102226]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bb81aa3d-13bb-497d-8443-cdd04cb09910 tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e" returned: 0 in 0.796s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bb81aa3d-13bb-497d-8443-cdd04cb09910 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e.ce81fd1d-59d3-4746-bf39-11fe5d7d772e 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:31 devstack sudo[102231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e.ce81fd1d-59d3-4746-bf39-11fe5d7d772e 1G Jul 10 18:23:31 devstack sudo[102231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:32 devstack sudo[102231]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bb81aa3d-13bb-497d-8443-cdd04cb09910 tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e.ce81fd1d-59d3-4746-bf39-11fe5d7d772e 1G" returned: 0 in 0.817s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bb81aa3d-13bb-497d-8443-cdd04cb09910 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e.ce81fd1d-59d3-4746-bf39-11fe5d7d772e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:32 devstack sudo[102237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e.ce81fd1d-59d3-4746-bf39-11fe5d7d772e Jul 10 18:23:32 devstack sudo[102237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:32 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e2ecd63d-8ccf-4401-a89d-dbe1029a0d6e tempest-VolumeQuotasAdminTestJSON-1675383287 None] Acquiring lock "cinder-37f56f6a-b500-4506-924c-37b7e401ab9d-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:23:32 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e2ecd63d-8ccf-4401-a89d-dbe1029a0d6e tempest-VolumeQuotasAdminTestJSON-1675383287 None] Lock "cinder-37f56f6a-b500-4506-924c-37b7e401ab9d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:23:32 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e2ecd63d-8ccf-4401-a89d-dbe1029a0d6e tempest-VolumeQuotasAdminTestJSON-1675383287 None] Acquiring lock "cinder-quobyte-37f56f6a-b500-4506-924c-37b7e401ab9d" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:23:32 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e2ecd63d-8ccf-4401-a89d-dbe1029a0d6e tempest-VolumeQuotasAdminTestJSON-1675383287 None] Lock "cinder-quobyte-37f56f6a-b500-4506-924c-37b7e401ab9d" acquired by "delete_volume" :: waited 0.014s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:23:32 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f252dd-35be-44e7-8fc4-7dd045dc19fa]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:23:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e2ecd63d-8ccf-4401-a89d-dbe1029a0d6e tempest-VolumeQuotasAdminTestJSON-1675383287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-37f56f6a-b500-4506-924c-37b7e401ab9d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:32 devstack sudo[102239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-37f56f6a-b500-4506-924c-37b7e401ab9d Jul 10 18:23:32 devstack sudo[102239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:33 devstack sudo[102237]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bb81aa3d-13bb-497d-8443-cdd04cb09910 tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e.ce81fd1d-59d3-4746-bf39-11fe5d7d772e" returned: 0 in 0.732s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:33 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-bb81aa3d-13bb-497d-8443-cdd04cb09910 tempest-CreateVolumesFromSnapshotTest-2004692303 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e.ce81fd1d-59d3-4746-bf39-11fe5d7d772e is being set with open permissions: ugo+rw Jul 10 18:23:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bb81aa3d-13bb-497d-8443-cdd04cb09910 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e.ce81fd1d-59d3-4746-bf39-11fe5d7d772e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:33 devstack sudo[102245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e.ce81fd1d-59d3-4746-bf39-11fe5d7d772e Jul 10 18:23:33 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:33 devstack sudo[102239]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e2ecd63d-8ccf-4401-a89d-dbe1029a0d6e tempest-VolumeQuotasAdminTestJSON-1675383287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-37f56f6a-b500-4506-924c-37b7e401ab9d" returned: 0 in 0.787s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e2ecd63d-8ccf-4401-a89d-dbe1029a0d6e tempest-VolumeQuotasAdminTestJSON-1675383287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-37f56f6a-b500-4506-924c-37b7e401ab9d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:33 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-37f56f6a-b500-4506-924c-37b7e401ab9d Jul 10 18:23:33 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:33 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bb81aa3d-13bb-497d-8443-cdd04cb09910 tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e.ce81fd1d-59d3-4746-bf39-11fe5d7d772e" returned: 0 in 0.668s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bb81aa3d-13bb-497d-8443-cdd04cb09910 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:34 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e.info Jul 10 18:23:34 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:34 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e2ecd63d-8ccf-4401-a89d-dbe1029a0d6e tempest-VolumeQuotasAdminTestJSON-1675383287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-37f56f6a-b500-4506-924c-37b7e401ab9d" returned: 0 in 0.657s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:34 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e2ecd63d-8ccf-4401-a89d-dbe1029a0d6e tempest-VolumeQuotasAdminTestJSON-1675383287 None] Lock "cinder-quobyte-37f56f6a-b500-4506-924c-37b7e401ab9d" released by "delete_volume" :: held 1.486s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:23:34 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-e2ecd63d-8ccf-4401-a89d-dbe1029a0d6e tempest-VolumeQuotasAdminTestJSON-1675383287 None] Created reservations ['1667d38c-c37a-4c55-9d35-677cd9e5ea17', '3d05df5f-f77f-4bf7-9a08-c474894ef0cb', '8bce8c72-8045-4c60-ae2b-0d5f33224640', 'bfebc747-66fa-4bcd-a566-ba5edcc8788c'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:23:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e2ecd63d-8ccf-4401-a89d-dbe1029a0d6e tempest-VolumeQuotasAdminTestJSON-1675383287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:23:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e2ecd63d-8ccf-4401-a89d-dbe1029a0d6e tempest-VolumeQuotasAdminTestJSON-1675383287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:23:34 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e2ecd63d-8ccf-4401-a89d-dbe1029a0d6e tempest-VolumeQuotasAdminTestJSON-1675383287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:23:34 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e2ecd63d-8ccf-4401-a89d-dbe1029a0d6e tempest-VolumeQuotasAdminTestJSON-1675383287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:23:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e2ecd63d-8ccf-4401-a89d-dbe1029a0d6e tempest-VolumeQuotasAdminTestJSON-1675383287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:23:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e2ecd63d-8ccf-4401-a89d-dbe1029a0d6e tempest-VolumeQuotasAdminTestJSON-1675383287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:34 devstack sudo[102256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:23:34 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:34 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bb81aa3d-13bb-497d-8443-cdd04cb09910 tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e.info" returned: 0 in 0.662s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:34 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-bb81aa3d-13bb-497d-8443-cdd04cb09910 tempest-CreateVolumesFromSnapshotTest-2004692303 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e.info is being set with open permissions: ugo+rw Jul 10 18:23:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bb81aa3d-13bb-497d-8443-cdd04cb09910 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:34 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e.info Jul 10 18:23:34 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:35 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e2ecd63d-8ccf-4401-a89d-dbe1029a0d6e tempest-VolumeQuotasAdminTestJSON-1675383287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.658s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:35 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-e2ecd63d-8ccf-4401-a89d-dbe1029a0d6e tempest-VolumeQuotasAdminTestJSON-1675383287 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:23:35 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-e2ecd63d-8ccf-4401-a89d-dbe1029a0d6e tempest-VolumeQuotasAdminTestJSON-1675383287 None] Deleted volume successfully. Jul 10 18:23:35 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e2ecd63d-8ccf-4401-a89d-dbe1029a0d6e tempest-VolumeQuotasAdminTestJSON-1675383287 None] Lock "cinder-37f56f6a-b500-4506-924c-37b7e401ab9d-delete_volume" released by "delete_volume" :: held 2.391s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:23:35 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bb81aa3d-13bb-497d-8443-cdd04cb09910 tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e.info" returned: 0 in 0.678s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-bb81aa3d-13bb-497d-8443-cdd04cb09910 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.471s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:23:35 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-bb81aa3d-13bb-497d-8443-cdd04cb09910 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Create snapshot completed successfully Jul 10 18:23:36 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:23:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Flow 'volume_create_manager' (5bf22c0d-b32d-4f23-a5bc-13d27709f1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:23:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c5c533f-4ca0-495e-9747-e648dd09d33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c5c533f-4ca0-495e-9747-e648dd09d33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1645428655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2da074d7-123e-4833-9b5b-f8c515c98c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834ab53207b1466a8533b1b37b50fc51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:23:37Z,use_quota=True,user_id='8fbc02d95bed4db8a6057273a44f3875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56463feb-0fd3-49c9-905c-e89ea5ccc686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56463feb-0fd3-49c9-905c-e89ea5ccc686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b52b3c-6cbe-48d6-b11f-8e24fc665787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4b52b3c-6cbe-48d6-b11f-8e24fc665787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2da074d7-123e-4833-9b5b-f8c515c98c48', 'volume_name': 'volume-2da074d7-123e-4833-9b5b-f8c515c98c48', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736bfe05-0171-460d-bf0a-b2bc904ac566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736bfe05-0171-460d-bf0a-b2bc904ac566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb3e1f5-dc59-4348-abdf-4828d3026ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:36 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Volume 2da074d7-123e-4833-9b5b-f8c515c98c48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2da074d7-123e-4833-9b5b-f8c515c98c48', 'volume_size': 1} Jul 10 18:23:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:23:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:23:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1645428655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2da074d7-123e-4833-9b5b-f8c515c98c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834ab53207b1466a8533b1b37b50fc51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:23:37Z,use_quota=True,user_id='8fbc02d95bed4db8a6057273a44f3875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:23:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Creating volume 2da074d7-123e-4833-9b5b-f8c515c98c48 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:23:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:23:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:23:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:23:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:23:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:23:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:23:36 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:23:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2da074d7-123e-4833-9b5b-f8c515c98c48 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:36 devstack sudo[102264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2da074d7-123e-4833-9b5b-f8c515c98c48 1073741824 Jul 10 18:23:36 devstack sudo[102264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] Flow 'volume_create_manager' (6f3b4650-bf16-4897-9ec8-5361de4d328b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (164325ce-b329-4f79-a9b7-22ac5c2500f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (164325ce-b329-4f79-a9b7-22ac5c2500f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-634420918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34d82b91-f362-491b-98d9-612550b9cf59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834ab53207b1466a8533b1b37b50fc51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:23:37Z,use_quota=True,user_id='8fbc02d95bed4db8a6057273a44f3875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (604e555a-8433-478c-900a-5259525b3719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (604e555a-8433-478c-900a-5259525b3719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63dfb04-ca20-4d45-bd04-dab8b2d911d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b63dfb04-ca20-4d45-bd04-dab8b2d911d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34d82b91-f362-491b-98d9-612550b9cf59', 'volume_name': 'volume-34d82b91-f362-491b-98d9-612550b9cf59', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9745ffb-d6ea-4ce5-b970-b79196296aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9745ffb-d6ea-4ce5-b970-b79196296aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d845c7e5-947b-4345-b422-be3f13993f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:37 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] Volume 34d82b91-f362-491b-98d9-612550b9cf59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34d82b91-f362-491b-98d9-612550b9cf59', 'volume_size': 1} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Flow 'volume_create_manager' (5195e953-cc60-415b-85b7-2a868c0b2aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3476d00-81e0-4719-abb5-e298d990c4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3476d00-81e0-4719-abb5-e298d990c4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-155051794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00816a66-ffd8-43c1-9984-c2d23bb02261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834ab53207b1466a8533b1b37b50fc51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:23:37Z,use_quota=True,user_id='8fbc02d95bed4db8a6057273a44f3875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a28418-6d3b-464a-959d-e4dbcc06fe92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a28418-6d3b-464a-959d-e4dbcc06fe92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32b4461-e906-42a5-bc6c-ed5168426ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32b4461-e906-42a5-bc6c-ed5168426ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00816a66-ffd8-43c1-9984-c2d23bb02261', 'volume_name': 'volume-00816a66-ffd8-43c1-9984-c2d23bb02261', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e33088e4-6722-48a8-91f6-6e929e007d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e33088e4-6722-48a8-91f6-6e929e007d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bbaaf65-b0b1-4d3b-b395-a5c9c9f74129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:37 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Volume 00816a66-ffd8-43c1-9984-c2d23bb02261: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00816a66-ffd8-43c1-9984-c2d23bb02261', 'volume_size': 1} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:23:37 devstack sudo[102264]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Flow 'volume_create_manager' (0443ded9-ab6a-4a83-9e27-9cf6b284a66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740e1397-90fa-465c-b47a-4255564b42b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2da074d7-123e-4833-9b5b-f8c515c98c48 1073741824" returned: 0 in 1.107s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740e1397-90fa-465c-b47a-4255564b42b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1533973895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f4d7b36-d504-44d8-8848-caae2f2704e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834ab53207b1466a8533b1b37b50fc51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:23:38Z,use_quota=True,user_id='8fbc02d95bed4db8a6057273a44f3875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (007d02b1-fd25-4a98-8fcf-4716bc9d5db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (007d02b1-fd25-4a98-8fcf-4716bc9d5db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e0e6896-d439-45cf-829e-dd6ab36780c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e0e6896-d439-45cf-829e-dd6ab36780c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f4d7b36-d504-44d8-8848-caae2f2704e4', 'volume_name': 'volume-5f4d7b36-d504-44d8-8848-caae2f2704e4', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (079e60f4-d7dd-415a-9cd1-eb640186fe72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (079e60f4-d7dd-415a-9cd1-eb640186fe72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a2b33fc-e9bf-4897-b1aa-6e04cc6700d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:37 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Volume 5f4d7b36-d504-44d8-8848-caae2f2704e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f4d7b36-d504-44d8-8848-caae2f2704e4', 'volume_size': 1} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:23:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2da074d7-123e-4833-9b5b-f8c515c98c48 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:38 devstack sudo[102270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2da074d7-123e-4833-9b5b-f8c515c98c48 Jul 10 18:23:38 devstack sudo[102270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:38 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:23:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Flow 'volume_create_manager' (83a32c40-f4db-419f-be2a-983791b8c4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:23:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011e970d-ae81-43bc-a965-67f6686a924c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (011e970d-ae81-43bc-a965-67f6686a924c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1867411358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=903b8b39-8c8d-4e67-812d-2a4354b23b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834ab53207b1466a8533b1b37b50fc51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:23:38Z,use_quota=True,user_id='8fbc02d95bed4db8a6057273a44f3875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f54b40-3315-416d-bd1e-adce27e12ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f54b40-3315-416d-bd1e-adce27e12ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e0989b-03ee-4bbf-b524-9a31615c6d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e0989b-03ee-4bbf-b524-9a31615c6d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '903b8b39-8c8d-4e67-812d-2a4354b23b76', 'volume_name': 'volume-903b8b39-8c8d-4e67-812d-2a4354b23b76', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0105dd58-1272-48d8-aeaa-35abdaa9aecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0105dd58-1272-48d8-aeaa-35abdaa9aecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3b0819d-ee32-4f8c-b5e5-42c5916177fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:38 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Volume 903b8b39-8c8d-4e67-812d-2a4354b23b76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-903b8b39-8c8d-4e67-812d-2a4354b23b76', 'volume_size': 1} Jul 10 18:23:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:23:38 devstack sudo[102270]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2da074d7-123e-4833-9b5b-f8c515c98c48" returned: 0 in 0.685s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] <== create_volume: return (1888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:23:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:23:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.542s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:23:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-634420918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34d82b91-f362-491b-98d9-612550b9cf59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834ab53207b1466a8533b1b37b50fc51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:23:37Z,use_quota=True,user_id='8fbc02d95bed4db8a6057273a44f3875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:23:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] Creating volume 34d82b91-f362-491b-98d9-612550b9cf59 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:23:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:23:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:23:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:23:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:23:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:23:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:23:38 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:23:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-34d82b91-f362-491b-98d9-612550b9cf59 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb3e1f5-dc59-4348-abdf-4828d3026ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2da074d7-123e-4833-9b5b-f8c515c98c48', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:38 devstack sudo[102273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-34d82b91-f362-491b-98d9-612550b9cf59 1073741824 Jul 10 18:23:38 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ded8257-99de-4462-907e-2a442869ceeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:38 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Volume volume-2da074d7-123e-4833-9b5b-f8c515c98c48 (2da074d7-123e-4833-9b5b-f8c515c98c48): created successfully Jul 10 18:23:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ded8257-99de-4462-907e-2a442869ceeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Flow 'volume_create_manager' (5bf22c0d-b32d-4f23-a5bc-13d27709f1fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:23:38 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-6fa4cfbe-0f7e-432a-9dd9-f6c123dbf42c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Created volume successfully. Jul 10 18:23:39 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-34d82b91-f362-491b-98d9-612550b9cf59 1073741824" returned: 0 in 0.904s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-34d82b91-f362-491b-98d9-612550b9cf59 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:39 devstack sudo[102278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-34d82b91-f362-491b-98d9-612550b9cf59 Jul 10 18:23:39 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:40 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-34d82b91-f362-491b-98d9-612550b9cf59" returned: 0 in 0.674s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:40 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:23:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:23:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.790s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:23:40 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-155051794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00816a66-ffd8-43c1-9984-c2d23bb02261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834ab53207b1466a8533b1b37b50fc51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:23:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:23:37Z,use_quota=True,user_id='8fbc02d95bed4db8a6057273a44f3875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:23:40 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Creating volume 00816a66-ffd8-43c1-9984-c2d23bb02261 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:23:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:23:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:23:40 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:23:40 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:23:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:23:40 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:23:40 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:23:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-00816a66-ffd8-43c1-9984-c2d23bb02261 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d845c7e5-947b-4345-b422-be3f13993f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34d82b91-f362-491b-98d9-612550b9cf59', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:40 devstack sudo[102281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-00816a66-ffd8-43c1-9984-c2d23bb02261 1073741824 Jul 10 18:23:40 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee1c41b0-ec00-4a83-8a96-187c034d1ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:40 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] Volume volume-34d82b91-f362-491b-98d9-612550b9cf59 (34d82b91-f362-491b-98d9-612550b9cf59): created successfully Jul 10 18:23:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee1c41b0-ec00-4a83-8a96-187c034d1ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] Flow 'volume_create_manager' (6f3b4650-bf16-4897-9ec8-5361de4d328b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:23:40 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-43e1c0df-e434-4883-ba80-b43760af72fa tempest-CreateVolumesFromSnapshotTest-2004692303 None] Created volume successfully. Jul 10 18:23:41 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-00816a66-ffd8-43c1-9984-c2d23bb02261 1073741824" returned: 0 in 0.872s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-00816a66-ffd8-43c1-9984-c2d23bb02261 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:41 devstack sudo[102287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-00816a66-ffd8-43c1-9984-c2d23bb02261 Jul 10 18:23:41 devstack sudo[102287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:41 devstack sudo[102287]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-00816a66-ffd8-43c1-9984-c2d23bb02261" returned: 0 in 0.677s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:41 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:23:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:23:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.954s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:23:41 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:23:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1533973895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f4d7b36-d504-44d8-8848-caae2f2704e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834ab53207b1466a8533b1b37b50fc51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:23:38Z,use_quota=True,user_id='8fbc02d95bed4db8a6057273a44f3875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:23:41 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Creating volume 5f4d7b36-d504-44d8-8848-caae2f2704e4 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:23:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:23:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:23:41 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:23:41 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:23:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:23:41 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:23:41 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:23:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5f4d7b36-d504-44d8-8848-caae2f2704e4 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:41 devstack sudo[102290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5f4d7b36-d504-44d8-8848-caae2f2704e4 1073741824 Jul 10 18:23:41 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bbaaf65-b0b1-4d3b-b395-a5c9c9f74129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00816a66-ffd8-43c1-9984-c2d23bb02261', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e59fbd0-0ca5-4633-b874-9e7487a71bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:41 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Volume volume-00816a66-ffd8-43c1-9984-c2d23bb02261 (00816a66-ffd8-43c1-9984-c2d23bb02261): created successfully Jul 10 18:23:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e59fbd0-0ca5-4633-b874-9e7487a71bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Flow 'volume_create_manager' (5195e953-cc60-415b-85b7-2a868c0b2aaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:23:41 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-127da1c5-2f87-4bcd-bc71-06f2d228b8a2 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Created volume successfully. Jul 10 18:23:42 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5f4d7b36-d504-44d8-8848-caae2f2704e4 1073741824" returned: 0 in 0.883s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5f4d7b36-d504-44d8-8848-caae2f2704e4 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:42 devstack sudo[102296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5f4d7b36-d504-44d8-8848-caae2f2704e4 Jul 10 18:23:42 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:43 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5f4d7b36-d504-44d8-8848-caae2f2704e4" returned: 0 in 0.678s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:43 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:23:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:23:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.210s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:23:43 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1867411358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=903b8b39-8c8d-4e67-812d-2a4354b23b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834ab53207b1466a8533b1b37b50fc51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:23:38Z,use_quota=True,user_id='8fbc02d95bed4db8a6057273a44f3875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:23:43 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Creating volume 903b8b39-8c8d-4e67-812d-2a4354b23b76 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:23:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:23:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:23:43 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:23:43 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:23:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:23:43 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:23:43 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:23:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-903b8b39-8c8d-4e67-812d-2a4354b23b76 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:43 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:23:43 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-903b8b39-8c8d-4e67-812d-2a4354b23b76 1073741824 Jul 10 18:23:43 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] Flow 'volume_create_manager' (53c15100-480c-4067-8130-22c1029a3555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:23:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d05ca602-2e65-4aad-9df9-e79c1129e93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a2b33fc-e9bf-4897-b1aa-6e04cc6700d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f4d7b36-d504-44d8-8848-caae2f2704e4', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fc180dd-08ba-4ef0-8670-891423ccd98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d05ca602-2e65-4aad-9df9-e79c1129e93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-790705683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cc54b60-c517-431c-8697-504e250c2efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a105508e144e6daa9752710d9dff41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:23:43Z,use_quota=True,user_id='78acfa78d71548bd8d408dda70168241',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2560cba1-6730-4cf2-93fc-677ecdec97d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2560cba1-6730-4cf2-93fc-677ecdec97d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be118e0f-e358-4b77-a6f3-aeadd3a1659f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be118e0f-e358-4b77-a6f3-aeadd3a1659f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cc54b60-c517-431c-8697-504e250c2efd', 'volume_name': 'volume-1cc54b60-c517-431c-8697-504e250c2efd', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (845c291d-1401-4368-8c1c-e897d4036a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (845c291d-1401-4368-8c1c-e897d4036a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6407a129-609d-41a1-a0af-1bf6bef7dcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:43 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] Volume 1cc54b60-c517-431c-8697-504e250c2efd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cc54b60-c517-431c-8697-504e250c2efd', 'volume_size': 1} Jul 10 18:23:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:23:43 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Volume volume-5f4d7b36-d504-44d8-8848-caae2f2704e4 (5f4d7b36-d504-44d8-8848-caae2f2704e4): created successfully Jul 10 18:23:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fc180dd-08ba-4ef0-8670-891423ccd98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Flow 'volume_create_manager' (0443ded9-ab6a-4a83-9e27-9cf6b284a66a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:23:43 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-8343fcca-3b02-4427-9a86-8afd39282790 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Created volume successfully. Jul 10 18:23:44 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-903b8b39-8c8d-4e67-812d-2a4354b23b76 1073741824" returned: 0 in 0.826s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-903b8b39-8c8d-4e67-812d-2a4354b23b76 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:44 devstack sudo[102304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-903b8b39-8c8d-4e67-812d-2a4354b23b76 Jul 10 18:23:44 devstack sudo[102304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:45 devstack sudo[102304]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-903b8b39-8c8d-4e67-812d-2a4354b23b76" returned: 0 in 0.636s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:45 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:23:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:23:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.380s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:23:45 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-790705683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cc54b60-c517-431c-8697-504e250c2efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a105508e144e6daa9752710d9dff41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:23:43Z,use_quota=True,user_id='78acfa78d71548bd8d408dda70168241',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:23:45 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] Creating volume 1cc54b60-c517-431c-8697-504e250c2efd {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:23:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:23:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:23:45 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:23:45 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:23:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:23:45 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:23:45 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:23:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:45 devstack sudo[102307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd 1073741824 Jul 10 18:23:45 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:45 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3b0819d-ee32-4f8c-b5e5-42c5916177fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-903b8b39-8c8d-4e67-812d-2a4354b23b76', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:45 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c31bf27-6911-491b-a44e-56adafd35041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:45 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Volume volume-903b8b39-8c8d-4e67-812d-2a4354b23b76 (903b8b39-8c8d-4e67-812d-2a4354b23b76): created successfully Jul 10 18:23:45 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c31bf27-6911-491b-a44e-56adafd35041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:45 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Flow 'volume_create_manager' (83a32c40-f4db-419f-be2a-983791b8c4a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:23:45 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-e77f8938-2dbc-43ac-af07-65c6aeb6e0f4 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Created volume successfully. Jul 10 18:23:45 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd 1073741824" returned: 0 in 0.814s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:45 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd Jul 10 18:23:45 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:45 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3b0a0f67-fe87-4d97-969a-f787af0e0194 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "cinder-903b8b39-8c8d-4e67-812d-2a4354b23b76-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:23:45 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3b0a0f67-fe87-4d97-969a-f787af0e0194 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "cinder-903b8b39-8c8d-4e67-812d-2a4354b23b76-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:23:46 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3b0a0f67-fe87-4d97-969a-f787af0e0194 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "cinder-quobyte-903b8b39-8c8d-4e67-812d-2a4354b23b76" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:23:46 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3b0a0f67-fe87-4d97-969a-f787af0e0194 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "cinder-quobyte-903b8b39-8c8d-4e67-812d-2a4354b23b76" acquired by "delete_volume" :: waited 0.013s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:23:46 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[8353c8bf-cf99-47b6-9409-efe2e2ffaad1]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:23:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3b0a0f67-fe87-4d97-969a-f787af0e0194 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-903b8b39-8c8d-4e67-812d-2a4354b23b76 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:46 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-903b8b39-8c8d-4e67-812d-2a4354b23b76 Jul 10 18:23:46 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:46 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd" returned: 0 in 0.676s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:46 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:23:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:23:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6407a129-609d-41a1-a0af-1bf6bef7dcbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cc54b60-c517-431c-8697-504e250c2efd', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d3f7eae-3314-4cb0-ba63-e1fe17ec1d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:23:46 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] Volume volume-1cc54b60-c517-431c-8697-504e250c2efd (1cc54b60-c517-431c-8697-504e250c2efd): created successfully Jul 10 18:23:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d3f7eae-3314-4cb0-ba63-e1fe17ec1d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:23:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] Flow 'volume_create_manager' (53c15100-480c-4067-8130-22c1029a3555) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:23:46 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-21d9a6a8-f099-4fd3-a1cd-b45d1c5ddcbe tempest-VolumesDeleteCascade-1714871339 None] Created volume successfully. Jul 10 18:23:46 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3b0a0f67-fe87-4d97-969a-f787af0e0194 tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-903b8b39-8c8d-4e67-812d-2a4354b23b76" returned: 0 in 0.776s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3b0a0f67-fe87-4d97-969a-f787af0e0194 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-903b8b39-8c8d-4e67-812d-2a4354b23b76 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:46 devstack sudo[102321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-903b8b39-8c8d-4e67-812d-2a4354b23b76 Jul 10 18:23:46 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:47 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3b0a0f67-fe87-4d97-969a-f787af0e0194 tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-903b8b39-8c8d-4e67-812d-2a4354b23b76" returned: 0 in 0.648s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:47 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3b0a0f67-fe87-4d97-969a-f787af0e0194 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "cinder-quobyte-903b8b39-8c8d-4e67-812d-2a4354b23b76" released by "delete_volume" :: held 1.467s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:23:47 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-3b0a0f67-fe87-4d97-969a-f787af0e0194 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Created reservations ['1bbe7bb6-47d0-4d61-942f-c79f98baf904', '503f67ea-c604-4a2f-9d67-6397b54cc136', '227697ef-cc1c-4846-ba3b-c6fe148f3b03', '62b4d683-47ec-4ddf-958f-5282ce9bd5ae'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:23:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3b0a0f67-fe87-4d97-969a-f787af0e0194 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:23:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3b0a0f67-fe87-4d97-969a-f787af0e0194 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:23:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-3b0a0f67-fe87-4d97-969a-f787af0e0194 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:23:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-3b0a0f67-fe87-4d97-969a-f787af0e0194 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:23:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3b0a0f67-fe87-4d97-969a-f787af0e0194 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:23:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3b0a0f67-fe87-4d97-969a-f787af0e0194 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:47 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:23:47 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-41d01522-cbea-44dc-8476-49de9ddf2416 tempest-VolumesDeleteCascade-1714871339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:23:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-41d01522-cbea-44dc-8476-49de9ddf2416 tempest-VolumesDeleteCascade-1714871339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:23:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-41d01522-cbea-44dc-8476-49de9ddf2416 tempest-VolumesDeleteCascade-1714871339 None] Creating offline snapshot c72c8b8b-3101-438c-836a-9ae29b9ed4fb of volume 1cc54b60-c517-431c-8697-504e250c2efd {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:23:47 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[3948059e-9651-43ca-9968-9bdb408e485a]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:23:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-41d01522-cbea-44dc-8476-49de9ddf2416 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:48 devstack sudo[102326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd Jul 10 18:23:48 devstack sudo[102326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-471f669a-7f54-435b-8b4c-8e00284b72ba tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "cinder-5f4d7b36-d504-44d8-8848-caae2f2704e4-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:23:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-471f669a-7f54-435b-8b4c-8e00284b72ba tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "cinder-5f4d7b36-d504-44d8-8848-caae2f2704e4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:23:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-471f669a-7f54-435b-8b4c-8e00284b72ba tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "cinder-quobyte-5f4d7b36-d504-44d8-8848-caae2f2704e4" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:23:48 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3b0a0f67-fe87-4d97-969a-f787af0e0194 tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.679s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:48 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-3b0a0f67-fe87-4d97-969a-f787af0e0194 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:23:48 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-3b0a0f67-fe87-4d97-969a-f787af0e0194 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Deleted volume successfully. Jul 10 18:23:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-471f669a-7f54-435b-8b4c-8e00284b72ba tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "cinder-quobyte-5f4d7b36-d504-44d8-8848-caae2f2704e4" acquired by "delete_volume" :: waited 0.046s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:23:48 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[e736ba50-b75a-49de-918b-f9b57f4dd3ac]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:23:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-471f669a-7f54-435b-8b4c-8e00284b72ba tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5f4d7b36-d504-44d8-8848-caae2f2704e4 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3b0a0f67-fe87-4d97-969a-f787af0e0194 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "cinder-903b8b39-8c8d-4e67-812d-2a4354b23b76-delete_volume" released by "delete_volume" :: held 2.382s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:23:48 devstack sudo[102329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5f4d7b36-d504-44d8-8848-caae2f2704e4 Jul 10 18:23:48 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:48 devstack sudo[102326]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-41d01522-cbea-44dc-8476-49de9ddf2416 tempest-VolumesDeleteCascade-1714871339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd" returned: 0 in 0.817s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-41d01522-cbea-44dc-8476-49de9ddf2416 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.c72c8b8b-3101-438c-836a-9ae29b9ed4fb 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:48 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.c72c8b8b-3101-438c-836a-9ae29b9ed4fb 1G Jul 10 18:23:48 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:49 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-471f669a-7f54-435b-8b4c-8e00284b72ba tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5f4d7b36-d504-44d8-8848-caae2f2704e4" returned: 0 in 0.791s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-471f669a-7f54-435b-8b4c-8e00284b72ba tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5f4d7b36-d504-44d8-8848-caae2f2704e4 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:49 devstack sudo[102375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5f4d7b36-d504-44d8-8848-caae2f2704e4 Jul 10 18:23:49 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:49 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-41d01522-cbea-44dc-8476-49de9ddf2416 tempest-VolumesDeleteCascade-1714871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.c72c8b8b-3101-438c-836a-9ae29b9ed4fb 1G" returned: 0 in 0.868s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-41d01522-cbea-44dc-8476-49de9ddf2416 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cc54b60-c517-431c-8697-504e250c2efd -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.c72c8b8b-3101-438c-836a-9ae29b9ed4fb {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:49 devstack sudo[102380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cc54b60-c517-431c-8697-504e250c2efd -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.c72c8b8b-3101-438c-836a-9ae29b9ed4fb Jul 10 18:23:49 devstack sudo[102380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:49 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-471f669a-7f54-435b-8b4c-8e00284b72ba tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5f4d7b36-d504-44d8-8848-caae2f2704e4" returned: 0 in 0.696s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:49 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-471f669a-7f54-435b-8b4c-8e00284b72ba tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "cinder-quobyte-5f4d7b36-d504-44d8-8848-caae2f2704e4" released by "delete_volume" :: held 1.535s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:23:49 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-471f669a-7f54-435b-8b4c-8e00284b72ba tempest-CreateVolumesFromSnapshotTest-2004692303 None] Created reservations ['da27a234-5677-4664-847c-cff2ac64528f', '7abf66b3-78ec-4804-9a2e-531f8d039e57', '4cf3727b-5560-4ea8-af37-5f115d8edb27', 'b99fe40c-8f25-4af4-a332-f6c7c228224b'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:23:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-471f669a-7f54-435b-8b4c-8e00284b72ba tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:23:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-471f669a-7f54-435b-8b4c-8e00284b72ba tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:23:49 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-471f669a-7f54-435b-8b4c-8e00284b72ba tempest-CreateVolumesFromSnapshotTest-2004692303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:23:49 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-471f669a-7f54-435b-8b4c-8e00284b72ba tempest-CreateVolumesFromSnapshotTest-2004692303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:23:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-471f669a-7f54-435b-8b4c-8e00284b72ba tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:23:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-471f669a-7f54-435b-8b4c-8e00284b72ba tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:49 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:23:49 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:50 devstack sudo[102380]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-41d01522-cbea-44dc-8476-49de9ddf2416 tempest-VolumesDeleteCascade-1714871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cc54b60-c517-431c-8697-504e250c2efd -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.c72c8b8b-3101-438c-836a-9ae29b9ed4fb" returned: 0 in 0.701s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:50 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-41d01522-cbea-44dc-8476-49de9ddf2416 tempest-VolumesDeleteCascade-1714871339 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.c72c8b8b-3101-438c-836a-9ae29b9ed4fb is being set with open permissions: ugo+rw Jul 10 18:23:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-41d01522-cbea-44dc-8476-49de9ddf2416 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.c72c8b8b-3101-438c-836a-9ae29b9ed4fb {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:50 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.c72c8b8b-3101-438c-836a-9ae29b9ed4fb Jul 10 18:23:50 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:50 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-15d65f48-7075-4410-a48a-d258c41bbffe tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "cinder-00816a66-ffd8-43c1-9984-c2d23bb02261-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:23:50 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-15d65f48-7075-4410-a48a-d258c41bbffe tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "cinder-00816a66-ffd8-43c1-9984-c2d23bb02261-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:23:50 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-15d65f48-7075-4410-a48a-d258c41bbffe tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "cinder-quobyte-00816a66-ffd8-43c1-9984-c2d23bb02261" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:23:50 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-15d65f48-7075-4410-a48a-d258c41bbffe tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "cinder-quobyte-00816a66-ffd8-43c1-9984-c2d23bb02261" acquired by "delete_volume" :: waited 0.024s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:23:50 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[47add0f4-eafa-4271-a9fa-919efea0b14e]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:23:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-15d65f48-7075-4410-a48a-d258c41bbffe tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-00816a66-ffd8-43c1-9984-c2d23bb02261 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:50 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-471f669a-7f54-435b-8b4c-8e00284b72ba tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.717s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:50 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-471f669a-7f54-435b-8b4c-8e00284b72ba tempest-CreateVolumesFromSnapshotTest-2004692303 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:23:50 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-471f669a-7f54-435b-8b4c-8e00284b72ba tempest-CreateVolumesFromSnapshotTest-2004692303 None] Deleted volume successfully. Jul 10 18:23:50 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-471f669a-7f54-435b-8b4c-8e00284b72ba tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "cinder-5f4d7b36-d504-44d8-8848-caae2f2704e4-delete_volume" released by "delete_volume" :: held 2.510s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:23:50 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-00816a66-ffd8-43c1-9984-c2d23bb02261 Jul 10 18:23:50 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:50 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-41d01522-cbea-44dc-8476-49de9ddf2416 tempest-VolumesDeleteCascade-1714871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.c72c8b8b-3101-438c-836a-9ae29b9ed4fb" returned: 0 in 0.674s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-41d01522-cbea-44dc-8476-49de9ddf2416 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:51 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.info Jul 10 18:23:51 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:51 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-15d65f48-7075-4410-a48a-d258c41bbffe tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-00816a66-ffd8-43c1-9984-c2d23bb02261" returned: 0 in 0.786s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-15d65f48-7075-4410-a48a-d258c41bbffe tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-00816a66-ffd8-43c1-9984-c2d23bb02261 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:51 devstack sudo[102399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-00816a66-ffd8-43c1-9984-c2d23bb02261 Jul 10 18:23:51 devstack sudo[102399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:51 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-41d01522-cbea-44dc-8476-49de9ddf2416 tempest-VolumesDeleteCascade-1714871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.info" returned: 0 in 0.695s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:51 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-41d01522-cbea-44dc-8476-49de9ddf2416 tempest-VolumesDeleteCascade-1714871339 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.info is being set with open permissions: ugo+rw Jul 10 18:23:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-41d01522-cbea-44dc-8476-49de9ddf2416 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:51 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.info Jul 10 18:23:51 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:52 devstack sudo[102399]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-15d65f48-7075-4410-a48a-d258c41bbffe tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-00816a66-ffd8-43c1-9984-c2d23bb02261" returned: 0 in 0.656s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-15d65f48-7075-4410-a48a-d258c41bbffe tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "cinder-quobyte-00816a66-ffd8-43c1-9984-c2d23bb02261" released by "delete_volume" :: held 1.493s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:23:52 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-15d65f48-7075-4410-a48a-d258c41bbffe tempest-CreateVolumesFromSnapshotTest-2004692303 None] Created reservations ['0c77d834-f83c-4f55-a205-3081c44b4b74', '950d123b-eec9-4ea6-9415-d376ae850507', '15a6f243-f856-484f-a49a-db5d5fe6d29c', 'bc0f4c08-d186-4827-900b-af02dba389ad'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:23:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-15d65f48-7075-4410-a48a-d258c41bbffe tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:23:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-15d65f48-7075-4410-a48a-d258c41bbffe tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:23:52 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-15d65f48-7075-4410-a48a-d258c41bbffe tempest-CreateVolumesFromSnapshotTest-2004692303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:23:52 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-15d65f48-7075-4410-a48a-d258c41bbffe tempest-CreateVolumesFromSnapshotTest-2004692303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:23:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-15d65f48-7075-4410-a48a-d258c41bbffe tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:23:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-15d65f48-7075-4410-a48a-d258c41bbffe tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:52 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:23:52 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:52 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-41d01522-cbea-44dc-8476-49de9ddf2416 tempest-VolumesDeleteCascade-1714871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.info" returned: 0 in 0.675s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-41d01522-cbea-44dc-8476-49de9ddf2416 tempest-VolumesDeleteCascade-1714871339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.513s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:23:52 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-41d01522-cbea-44dc-8476-49de9ddf2416 tempest-VolumesDeleteCascade-1714871339 None] Create snapshot completed successfully Jul 10 18:23:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-46b82fa6-3e38-4e20-a400-2f8771efa853 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "cinder-34d82b91-f362-491b-98d9-612550b9cf59-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:23:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-46b82fa6-3e38-4e20-a400-2f8771efa853 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "cinder-34d82b91-f362-491b-98d9-612550b9cf59-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:23:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-46b82fa6-3e38-4e20-a400-2f8771efa853 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "cinder-quobyte-34d82b91-f362-491b-98d9-612550b9cf59" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:23:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-46b82fa6-3e38-4e20-a400-2f8771efa853 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "cinder-quobyte-34d82b91-f362-491b-98d9-612550b9cf59" acquired by "delete_volume" :: waited 0.018s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:23:52 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fa13ed-c8d1-4d7f-9550-7dc14a1af002]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:23:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-46b82fa6-3e38-4e20-a400-2f8771efa853 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-34d82b91-f362-491b-98d9-612550b9cf59 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:52 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-15d65f48-7075-4410-a48a-d258c41bbffe tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.686s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:52 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-15d65f48-7075-4410-a48a-d258c41bbffe tempest-CreateVolumesFromSnapshotTest-2004692303 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:23:52 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-15d65f48-7075-4410-a48a-d258c41bbffe tempest-CreateVolumesFromSnapshotTest-2004692303 None] Deleted volume successfully. Jul 10 18:23:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-15d65f48-7075-4410-a48a-d258c41bbffe tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "cinder-00816a66-ffd8-43c1-9984-c2d23bb02261-delete_volume" released by "delete_volume" :: held 2.416s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:23:52 devstack sudo[102410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-34d82b91-f362-491b-98d9-612550b9cf59 Jul 10 18:23:52 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-fea349da-6ecf-43f6-ba9f-48e591dab565 tempest-VolumesDeleteCascade-1714871339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:23:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-fea349da-6ecf-43f6-ba9f-48e591dab565 tempest-VolumesDeleteCascade-1714871339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:23:53 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-fea349da-6ecf-43f6-ba9f-48e591dab565 tempest-VolumesDeleteCascade-1714871339 None] Creating offline snapshot 131ac79e-e362-4a67-84d3-c009fb9dab80 of volume 1cc54b60-c517-431c-8697-504e250c2efd {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:23:53 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[628d8274-d041-4c0a-b9fc-362c9b77acd4]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:23:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fea349da-6ecf-43f6-ba9f-48e591dab565 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.c72c8b8b-3101-438c-836a-9ae29b9ed4fb {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:53 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.c72c8b8b-3101-438c-836a-9ae29b9ed4fb Jul 10 18:23:53 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:53 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-46b82fa6-3e38-4e20-a400-2f8771efa853 tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-34d82b91-f362-491b-98d9-612550b9cf59" returned: 0 in 0.790s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-46b82fa6-3e38-4e20-a400-2f8771efa853 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-34d82b91-f362-491b-98d9-612550b9cf59 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:53 devstack sudo[102417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-34d82b91-f362-491b-98d9-612550b9cf59 Jul 10 18:23:53 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:54 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fea349da-6ecf-43f6-ba9f-48e591dab565 tempest-VolumesDeleteCascade-1714871339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.c72c8b8b-3101-438c-836a-9ae29b9ed4fb" returned: 0 in 0.777s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:54 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-fea349da-6ecf-43f6-ba9f-48e591dab565 tempest-VolumesDeleteCascade-1714871339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cc54b60-c517-431c-8697-504e250c2efd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:23:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fea349da-6ecf-43f6-ba9f-48e591dab565 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.c72c8b8b-3101-438c-836a-9ae29b9ed4fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.131ac79e-e362-4a67-84d3-c009fb9dab80 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:54 devstack sudo[102422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.c72c8b8b-3101-438c-836a-9ae29b9ed4fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.131ac79e-e362-4a67-84d3-c009fb9dab80 1G Jul 10 18:23:54 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:54 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-46b82fa6-3e38-4e20-a400-2f8771efa853 tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-34d82b91-f362-491b-98d9-612550b9cf59" returned: 0 in 0.674s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:54 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-46b82fa6-3e38-4e20-a400-2f8771efa853 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "cinder-quobyte-34d82b91-f362-491b-98d9-612550b9cf59" released by "delete_volume" :: held 1.503s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:23:54 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-46b82fa6-3e38-4e20-a400-2f8771efa853 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Created reservations ['fbd723a8-4fa3-4a43-b7b3-ac38a6a5cf33', '346c4f79-6bef-4ff9-8711-dbadd794df21', '73c3c25a-8f0b-453b-aa0f-35bfd8f992c3', 'c68cc70c-2c9d-410c-9124-43b56535b84d'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:23:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-46b82fa6-3e38-4e20-a400-2f8771efa853 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:23:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-46b82fa6-3e38-4e20-a400-2f8771efa853 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:23:54 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-46b82fa6-3e38-4e20-a400-2f8771efa853 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:23:54 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-46b82fa6-3e38-4e20-a400-2f8771efa853 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:23:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-46b82fa6-3e38-4e20-a400-2f8771efa853 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:23:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-46b82fa6-3e38-4e20-a400-2f8771efa853 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:54 devstack sudo[102425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:23:54 devstack sudo[102425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:54 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fea349da-6ecf-43f6-ba9f-48e591dab565 tempest-VolumesDeleteCascade-1714871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.c72c8b8b-3101-438c-836a-9ae29b9ed4fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.131ac79e-e362-4a67-84d3-c009fb9dab80 1G" returned: 0 in 0.810s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fea349da-6ecf-43f6-ba9f-48e591dab565 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cc54b60-c517-431c-8697-504e250c2efd.c72c8b8b-3101-438c-836a-9ae29b9ed4fb -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.131ac79e-e362-4a67-84d3-c009fb9dab80 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:54 devstack sudo[102430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cc54b60-c517-431c-8697-504e250c2efd.c72c8b8b-3101-438c-836a-9ae29b9ed4fb -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.131ac79e-e362-4a67-84d3-c009fb9dab80 Jul 10 18:23:54 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:54 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-042f1bea-8606-4b05-b1df-ca3c744cc03b tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "cinder-2da074d7-123e-4833-9b5b-f8c515c98c48-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:23:54 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-042f1bea-8606-4b05-b1df-ca3c744cc03b tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "cinder-2da074d7-123e-4833-9b5b-f8c515c98c48-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:23:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-042f1bea-8606-4b05-b1df-ca3c744cc03b tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "cinder-quobyte-2da074d7-123e-4833-9b5b-f8c515c98c48" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:23:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-042f1bea-8606-4b05-b1df-ca3c744cc03b tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "cinder-quobyte-2da074d7-123e-4833-9b5b-f8c515c98c48" acquired by "delete_volume" :: waited 0.017s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:23:55 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a18abd6-e532-4b8b-9d49-8443e4c6c61e]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:23:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-042f1bea-8606-4b05-b1df-ca3c744cc03b tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2da074d7-123e-4833-9b5b-f8c515c98c48 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:55 devstack sudo[102425]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-46b82fa6-3e38-4e20-a400-2f8771efa853 tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.696s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:55 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-46b82fa6-3e38-4e20-a400-2f8771efa853 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:23:55 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-46b82fa6-3e38-4e20-a400-2f8771efa853 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Deleted volume successfully. Jul 10 18:23:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-46b82fa6-3e38-4e20-a400-2f8771efa853 tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "cinder-34d82b91-f362-491b-98d9-612550b9cf59-delete_volume" released by "delete_volume" :: held 2.404s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:23:55 devstack sudo[102433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2da074d7-123e-4833-9b5b-f8c515c98c48 Jul 10 18:23:55 devstack sudo[102433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:55 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fea349da-6ecf-43f6-ba9f-48e591dab565 tempest-VolumesDeleteCascade-1714871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cc54b60-c517-431c-8697-504e250c2efd.c72c8b8b-3101-438c-836a-9ae29b9ed4fb -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.131ac79e-e362-4a67-84d3-c009fb9dab80" returned: 0 in 0.696s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:55 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-fea349da-6ecf-43f6-ba9f-48e591dab565 tempest-VolumesDeleteCascade-1714871339 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.131ac79e-e362-4a67-84d3-c009fb9dab80 is being set with open permissions: ugo+rw Jul 10 18:23:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fea349da-6ecf-43f6-ba9f-48e591dab565 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.131ac79e-e362-4a67-84d3-c009fb9dab80 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:55 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.131ac79e-e362-4a67-84d3-c009fb9dab80 Jul 10 18:23:55 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:55 devstack sudo[102433]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-042f1bea-8606-4b05-b1df-ca3c744cc03b tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2da074d7-123e-4833-9b5b-f8c515c98c48" returned: 0 in 0.793s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-042f1bea-8606-4b05-b1df-ca3c744cc03b tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2da074d7-123e-4833-9b5b-f8c515c98c48 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:55 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2da074d7-123e-4833-9b5b-f8c515c98c48 Jul 10 18:23:55 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:56 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fea349da-6ecf-43f6-ba9f-48e591dab565 tempest-VolumesDeleteCascade-1714871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.131ac79e-e362-4a67-84d3-c009fb9dab80" returned: 0 in 0.646s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-fea349da-6ecf-43f6-ba9f-48e591dab565 tempest-VolumesDeleteCascade-1714871339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.013s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:23:56 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-fea349da-6ecf-43f6-ba9f-48e591dab565 tempest-VolumesDeleteCascade-1714871339 None] Create snapshot completed successfully Jul 10 18:23:56 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Acquiring lock "cinder-1cc54b60-c517-431c-8697-504e250c2efd-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:23:56 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-1cc54b60-c517-431c-8697-504e250c2efd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:23:56 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Performing cascade delete. {{(pid=87399) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 10 18:23:56 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-042f1bea-8606-4b05-b1df-ca3c744cc03b tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2da074d7-123e-4833-9b5b-f8c515c98c48" returned: 0 in 0.656s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:56 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Acquiring lock "cinder-131ac79e-e362-4a67-84d3-c009fb9dab80-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:23:56 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-042f1bea-8606-4b05-b1df-ca3c744cc03b tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "cinder-quobyte-2da074d7-123e-4833-9b5b-f8c515c98c48" released by "delete_volume" :: held 1.490s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:23:56 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-131ac79e-e362-4a67-84d3-c009fb9dab80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:23:56 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Acquiring lock "cinder-quobyte-1cc54b60-c517-431c-8697-504e250c2efd" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:23:56 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-quobyte-1cc54b60-c517-431c-8697-504e250c2efd" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:23:56 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Acquiring lock "cinder-quobyte-131ac79e-e362-4a67-84d3-c009fb9dab80" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:23:56 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-042f1bea-8606-4b05-b1df-ca3c744cc03b tempest-CreateVolumesFromSnapshotTest-2004692303 None] Created reservations ['1644814c-c445-49ba-98df-2f9a2c161907', '4b81ebf2-6f32-49db-a1df-76f413231242', '3c5f89b6-ca3e-4ffb-8829-25d843c9e2af', '8b37d728-640b-4ecb-a187-f48b72d981a5'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:23:56 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-quobyte-131ac79e-e362-4a67-84d3-c009fb9dab80" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:23:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Deleting offline snapshot 131ac79e-e362-4a67-84d3-c009fb9dab80 of volume 1cc54b60-c517-431c-8697-504e250c2efd {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:23:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] snapshot_file for this snap is: volume-1cc54b60-c517-431c-8697-504e250c2efd.131ac79e-e362-4a67-84d3-c009fb9dab80 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:23:56 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[43dd8320-89b3-4ba7-b076-a98702bf7afd]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:23:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.131ac79e-e362-4a67-84d3-c009fb9dab80 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-042f1bea-8606-4b05-b1df-ca3c744cc03b tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:23:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-042f1bea-8606-4b05-b1df-ca3c744cc03b tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:23:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-042f1bea-8606-4b05-b1df-ca3c744cc03b tempest-CreateVolumesFromSnapshotTest-2004692303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:23:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-042f1bea-8606-4b05-b1df-ca3c744cc03b tempest-CreateVolumesFromSnapshotTest-2004692303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:23:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-042f1bea-8606-4b05-b1df-ca3c744cc03b tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:23:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-042f1bea-8606-4b05-b1df-ca3c744cc03b tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:56 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:23:56 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:56 devstack sudo[102450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.131ac79e-e362-4a67-84d3-c009fb9dab80 Jul 10 18:23:56 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-934bd565-8d8d-4d0f-8d25-ff89b573eb1e tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "cinder-ce81fd1d-59d3-4746-bf39-11fe5d7d772e-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:23:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-934bd565-8d8d-4d0f-8d25-ff89b573eb1e tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "cinder-ce81fd1d-59d3-4746-bf39-11fe5d7d772e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:23:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-934bd565-8d8d-4d0f-8d25-ff89b573eb1e tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "cinder-quobyte-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:23:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-934bd565-8d8d-4d0f-8d25-ff89b573eb1e tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "cinder-quobyte-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:23:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-934bd565-8d8d-4d0f-8d25-ff89b573eb1e tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "cinder-quobyte-ce81fd1d-59d3-4746-bf39-11fe5d7d772e" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:23:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-934bd565-8d8d-4d0f-8d25-ff89b573eb1e tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "cinder-quobyte-ce81fd1d-59d3-4746-bf39-11fe5d7d772e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:23:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-934bd565-8d8d-4d0f-8d25-ff89b573eb1e tempest-CreateVolumesFromSnapshotTest-2004692303 None] Deleting offline snapshot ce81fd1d-59d3-4746-bf39-11fe5d7d772e of volume 09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:23:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-934bd565-8d8d-4d0f-8d25-ff89b573eb1e tempest-CreateVolumesFromSnapshotTest-2004692303 None] snapshot_file for this snap is: volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e.ce81fd1d-59d3-4746-bf39-11fe5d7d772e {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:23:57 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[e245b297-1789-4467-b334-4f14b8bcc541]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:23:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-934bd565-8d8d-4d0f-8d25-ff89b573eb1e tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e.ce81fd1d-59d3-4746-bf39-11fe5d7d772e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:57 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-042f1bea-8606-4b05-b1df-ca3c744cc03b tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.685s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:57 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-042f1bea-8606-4b05-b1df-ca3c744cc03b tempest-CreateVolumesFromSnapshotTest-2004692303 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:23:57 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-042f1bea-8606-4b05-b1df-ca3c744cc03b tempest-CreateVolumesFromSnapshotTest-2004692303 None] Deleted volume successfully. Jul 10 18:23:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-042f1bea-8606-4b05-b1df-ca3c744cc03b tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "cinder-2da074d7-123e-4833-9b5b-f8c515c98c48-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:23:57 devstack sudo[102457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e.ce81fd1d-59d3-4746-bf39-11fe5d7d772e Jul 10 18:23:57 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:57 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.131ac79e-e362-4a67-84d3-c009fb9dab80" returned: 0 in 0.808s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cc54b60-c517-431c-8697-504e250c2efd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:23:57 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f42409-3ea9-4178-b3e9-d064b34edccb]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:23:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.c72c8b8b-3101-438c-836a-9ae29b9ed4fb {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:57 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:23:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:23:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:23:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:23:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:23:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:23:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:57 devstack sudo[102461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:23:57 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:57 devstack sudo[102460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.c72c8b8b-3101-438c-836a-9ae29b9ed4fb Jul 10 18:23:57 devstack sudo[102460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:58 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-934bd565-8d8d-4d0f-8d25-ff89b573eb1e tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e.ce81fd1d-59d3-4746-bf39-11fe5d7d772e" returned: 0 in 0.812s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-934bd565-8d8d-4d0f-8d25-ff89b573eb1e tempest-CreateVolumesFromSnapshotTest-2004692303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:23:58 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b54f18-bec5-4aba-bf35-8e0e47de242c]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:23:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-934bd565-8d8d-4d0f-8d25-ff89b573eb1e tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:58 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.699s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:58 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:23:58 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager._thread_info {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:23:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread count: 28 {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 18:23:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread info: [<_MainThread(MainThread, started 139757428633728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 18:23:58 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e Jul 10 18:23:58 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:58 devstack sudo[102460]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.c72c8b8b-3101-438c-836a-9ae29b9ed4fb" returned: 0 in 0.803s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cc54b60-c517-431c-8697-504e250c2efd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:23:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.131ac79e-e362-4a67-84d3-c009fb9dab80 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:58 devstack sudo[102473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.131ac79e-e362-4a67-84d3-c009fb9dab80 Jul 10 18:23:58 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:58 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-934bd565-8d8d-4d0f-8d25-ff89b573eb1e tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e" returned: 0 in 0.783s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-934bd565-8d8d-4d0f-8d25-ff89b573eb1e tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e.ce81fd1d-59d3-4746-bf39-11fe5d7d772e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:58 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e.ce81fd1d-59d3-4746-bf39-11fe5d7d772e Jul 10 18:23:58 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:59 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.131ac79e-e362-4a67-84d3-c009fb9dab80" returned: 0 in 0.753s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.131ac79e-e362-4a67-84d3-c009fb9dab80 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:59 devstack sudo[102483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.131ac79e-e362-4a67-84d3-c009fb9dab80 Jul 10 18:23:59 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:59 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-934bd565-8d8d-4d0f-8d25-ff89b573eb1e tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e.ce81fd1d-59d3-4746-bf39-11fe5d7d772e" returned: 0 in 0.757s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-934bd565-8d8d-4d0f-8d25-ff89b573eb1e tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e.ce81fd1d-59d3-4746-bf39-11fe5d7d772e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:23:59 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e.ce81fd1d-59d3-4746-bf39-11fe5d7d772e Jul 10 18:23:59 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:23:59 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root Jul 10 18:23:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.131ac79e-e362-4a67-84d3-c009fb9dab80" returned: 0 in 0.680s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:23:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-quobyte-131ac79e-e362-4a67-84d3-c009fb9dab80" released by "_delete_snapshot" :: held 3.147s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:23:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-quobyte-1cc54b60-c517-431c-8697-504e250c2efd" released by "delete_snapshot" :: held 3.174s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:23:59 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Created reservations ['09f4fff5-67ce-4b8a-94b0-94a1c042864c', '9dd4e65f-d8f0-4706-9b23-27b23959b1fc', '041f19b4-2a02-4925-a57c-195c9ae5e84f', '6d852af3-8709-4130-85bd-5a3884ca745b'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:23:59 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Delete snapshot completed successfully. Jul 10 18:23:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-131ac79e-e362-4a67-84d3-c009fb9dab80-delete_snapshot" released by "delete_snapshot" :: held 3.319s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:23:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Acquiring lock "cinder-c72c8b8b-3101-438c-836a-9ae29b9ed4fb-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:23:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-c72c8b8b-3101-438c-836a-9ae29b9ed4fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:23:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Acquiring lock "cinder-quobyte-1cc54b60-c517-431c-8697-504e250c2efd" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:23:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-quobyte-1cc54b60-c517-431c-8697-504e250c2efd" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:23:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Acquiring lock "cinder-quobyte-c72c8b8b-3101-438c-836a-9ae29b9ed4fb" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:23:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-quobyte-c72c8b8b-3101-438c-836a-9ae29b9ed4fb" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:23:59 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Deleting offline snapshot c72c8b8b-3101-438c-836a-9ae29b9ed4fb of volume 1cc54b60-c517-431c-8697-504e250c2efd {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:23:59 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] snapshot_file for this snap is: volume-1cc54b60-c517-431c-8697-504e250c2efd.c72c8b8b-3101-438c-836a-9ae29b9ed4fb {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:23:59 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dea699d-0dd0-4171-bc9e-57744ef79e68]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:23:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.c72c8b8b-3101-438c-836a-9ae29b9ed4fb {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:00 devstack sudo[102491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.c72c8b8b-3101-438c-836a-9ae29b9ed4fb Jul 10 18:24:00 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:00 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-934bd565-8d8d-4d0f-8d25-ff89b573eb1e tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e.ce81fd1d-59d3-4746-bf39-11fe5d7d772e" returned: 0 in 0.674s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:00 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-934bd565-8d8d-4d0f-8d25-ff89b573eb1e tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "cinder-quobyte-ce81fd1d-59d3-4746-bf39-11fe5d7d772e" released by "_delete_snapshot" :: held 3.135s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:24:00 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-934bd565-8d8d-4d0f-8d25-ff89b573eb1e tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "cinder-quobyte-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e" released by "delete_snapshot" :: held 3.171s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:24:00 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-934bd565-8d8d-4d0f-8d25-ff89b573eb1e tempest-CreateVolumesFromSnapshotTest-2004692303 None] Created reservations ['97242bc7-535e-4243-ab0a-4e88488868e0', '45b4a9a1-908a-44b2-a132-3a35fa6348e3', 'fb2cb2c8-120b-41b0-a682-88f0db26f62d', '2d250fbe-060b-4b05-a19f-620427bb3911'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:24:00 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-934bd565-8d8d-4d0f-8d25-ff89b573eb1e tempest-CreateVolumesFromSnapshotTest-2004692303 None] Delete snapshot completed successfully. Jul 10 18:24:00 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-934bd565-8d8d-4d0f-8d25-ff89b573eb1e tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "cinder-ce81fd1d-59d3-4746-bf39-11fe5d7d772e-delete_snapshot" released by "delete_snapshot" :: held 3.303s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:24:00 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.c72c8b8b-3101-438c-836a-9ae29b9ed4fb" returned: 0 in 0.785s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cc54b60-c517-431c-8697-504e250c2efd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:24:00 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16aac99-ff5d-4ea5-bb18-69749bf1fdee]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:24:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:00 devstack sudo[102503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd Jul 10 18:24:00 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b50fe03a-8f6a-432f-8f9e-6a74264c701c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "cinder-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:24:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b50fe03a-8f6a-432f-8f9e-6a74264c701c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "cinder-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:24:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b50fe03a-8f6a-432f-8f9e-6a74264c701c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "cinder-quobyte-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:24:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b50fe03a-8f6a-432f-8f9e-6a74264c701c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "cinder-quobyte-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e" acquired by "delete_volume" :: waited 0.015s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:24:01 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b6451d-409b-474e-9b30-5f3a775b5eed]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:24:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b50fe03a-8f6a-432f-8f9e-6a74264c701c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:01 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd" returned: 0 in 0.820s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.c72c8b8b-3101-438c-836a-9ae29b9ed4fb {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:01 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.c72c8b8b-3101-438c-836a-9ae29b9ed4fb Jul 10 18:24:01 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:01 devstack sudo[102508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e Jul 10 18:24:01 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:02 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b50fe03a-8f6a-432f-8f9e-6a74264c701c tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e" returned: 0 in 0.771s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b50fe03a-8f6a-432f-8f9e-6a74264c701c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:02 devstack sudo[102518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e Jul 10 18:24:02 devstack sudo[102518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:02 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.c72c8b8b-3101-438c-836a-9ae29b9ed4fb" returned: 0 in 0.766s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.c72c8b8b-3101-438c-836a-9ae29b9ed4fb {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:02 devstack sudo[102520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.c72c8b8b-3101-438c-836a-9ae29b9ed4fb Jul 10 18:24:02 devstack sudo[102520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:02 devstack sudo[102518]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b50fe03a-8f6a-432f-8f9e-6a74264c701c tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e" returned: 0 in 0.663s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b50fe03a-8f6a-432f-8f9e-6a74264c701c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "cinder-quobyte-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e" released by "delete_volume" :: held 1.491s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:24:03 devstack sudo[102520]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd.c72c8b8b-3101-438c-836a-9ae29b9ed4fb" returned: 0 in 0.647s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:03 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-b50fe03a-8f6a-432f-8f9e-6a74264c701c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Created reservations ['6f6a60ec-8d57-448f-a1a9-5e2647325a34', '428654ce-24c1-4126-8c58-2d47430e03ab', 'e6c50f1b-efc5-4b36-8ee3-629254afa6a1', '3cf2c5e5-a29d-437c-9cb5-46ab92b69a8c'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:24:03 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-quobyte-c72c8b8b-3101-438c-836a-9ae29b9ed4fb" released by "_delete_snapshot" :: held 3.123s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:24:03 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-quobyte-1cc54b60-c517-431c-8697-504e250c2efd" released by "delete_snapshot" :: held 3.147s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:24:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b50fe03a-8f6a-432f-8f9e-6a74264c701c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b50fe03a-8f6a-432f-8f9e-6a74264c701c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b50fe03a-8f6a-432f-8f9e-6a74264c701c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:24:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b50fe03a-8f6a-432f-8f9e-6a74264c701c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:24:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b50fe03a-8f6a-432f-8f9e-6a74264c701c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b50fe03a-8f6a-432f-8f9e-6a74264c701c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:03 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Created reservations ['1bb205a1-92f0-4e2a-a894-b569803befd8', 'eb1f4346-4202-4669-b622-0fef42b81425', '52dd027d-5953-4f9b-9d9d-f908f27d0bdc', 'cc799d6a-2bfe-470e-84d6-9dc382d3863c'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:24:03 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:24:03 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:03 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Delete snapshot completed successfully. Jul 10 18:24:03 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-c72c8b8b-3101-438c-836a-9ae29b9ed4fb-delete_snapshot" released by "delete_snapshot" :: held 3.339s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:24:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Snapshots deleted, issuing volume delete {{(pid=87399) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 10 18:24:03 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Acquiring lock "cinder-quobyte-1cc54b60-c517-431c-8697-504e250c2efd" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:24:03 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-quobyte-1cc54b60-c517-431c-8697-504e250c2efd" acquired by "delete_volume" :: waited 0.018s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:24:03 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f3d2f5-3092-4fbb-8e8b-14329a3a4271]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:24:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:03 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd Jul 10 18:24:03 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:03 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b50fe03a-8f6a-432f-8f9e-6a74264c701c tempest-CreateVolumesFromSnapshotTest-2004692303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.696s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:03 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-b50fe03a-8f6a-432f-8f9e-6a74264c701c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:24:03 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-b50fe03a-8f6a-432f-8f9e-6a74264c701c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Deleted volume successfully. Jul 10 18:24:03 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b50fe03a-8f6a-432f-8f9e-6a74264c701c tempest-CreateVolumesFromSnapshotTest-2004692303 None] Lock "cinder-09cba7e1-e0d3-49d5-8d8e-5cdfaa06370e-delete_volume" released by "delete_volume" :: held 2.447s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:24:04 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd" returned: 0 in 0.800s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:04 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd Jul 10 18:24:04 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:04 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1cc54b60-c517-431c-8697-504e250c2efd" returned: 0 in 0.705s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:04 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-quobyte-1cc54b60-c517-431c-8697-504e250c2efd" released by "delete_volume" :: held 1.566s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:24:04 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Created reservations ['bf69c89e-242d-4995-8668-bbd986113b28', '3f6dab51-7094-4230-a7b1-26864dc81bcf', '3dfb1d44-e0d8-461c-8be2-91d842322440', '09246b75-f01a-4004-aad0-7d5b070717f2'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:24:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:04 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:24:04 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:24:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:04 devstack sudo[102536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:24:04 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:05 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.684s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:05 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:24:05 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Deleted volume successfully. Jul 10 18:24:05 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-cd34cf08-ac00-437e-9864-dc840469c965 tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-1cc54b60-c517-431c-8697-504e250c2efd-delete_volume" released by "delete_volume" :: held 9.177s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:24:05 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:24:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] Flow 'volume_create_manager' (02ccf450-40db-4fae-a568-88884d004441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:24:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a883ab2c-7db2-4be1-a5d9-8cb26bb95a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a883ab2c-7db2-4be1-a5d9-8cb26bb95a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-672939981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b01ee5-0de2-43a6-9036-b73c8ca08e2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a105508e144e6daa9752710d9dff41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:24:06Z,use_quota=True,user_id='78acfa78d71548bd8d408dda70168241',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7b84cd5-a233-4acd-906a-1d6bc4884e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7b84cd5-a233-4acd-906a-1d6bc4884e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7037863-8218-41ff-9136-e8ea02cf147d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7037863-8218-41ff-9136-e8ea02cf147d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8b01ee5-0de2-43a6-9036-b73c8ca08e2f', 'volume_name': 'volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a133e92b-7ecd-401c-aed7-39cd694502db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a133e92b-7ecd-401c-aed7-39cd694502db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e66e5dc6-1cc4-4308-bd97-386dd90487ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:05 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] Volume a8b01ee5-0de2-43a6-9036-b73c8ca08e2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f', 'volume_size': 1} Jul 10 18:24:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:05 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:24:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-672939981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b01ee5-0de2-43a6-9036-b73c8ca08e2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a105508e144e6daa9752710d9dff41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:24:06Z,use_quota=True,user_id='78acfa78d71548bd8d408dda70168241',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:24:05 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] Creating volume a8b01ee5-0de2-43a6-9036-b73c8ca08e2f {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:24:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:05 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:24:05 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:24:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:05 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:24:05 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:24:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:05 devstack sudo[102539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f 1073741824 Jul 10 18:24:05 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:06 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:24:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Flow 'volume_create_manager' (33f3351d-b7da-4177-83f4-ef01f4f161ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:24:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85fe66d0-dc3e-49a9-84e5-9287f1ef8c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85fe66d0-dc3e-49a9-84e5-9287f1ef8c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1713379747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c295ade-d025-4e5a-aba5-5217a5855ced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71711505a3404f58bfd6c3f26600bbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:24:06Z,use_quota=True,user_id='41d2545118c34059bb133fca72f07126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97395e5b-bd18-42a4-bd09-48d51d8c7bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97395e5b-bd18-42a4-bd09-48d51d8c7bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95de3da6-4b2f-4011-97bb-34d49f323cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95de3da6-4b2f-4011-97bb-34d49f323cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c295ade-d025-4e5a-aba5-5217a5855ced', 'volume_name': 'volume-5c295ade-d025-4e5a-aba5-5217a5855ced', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83f354aa-4fb8-4f1a-99bf-a2aae576e7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83f354aa-4fb8-4f1a-99bf-a2aae576e7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5469bfb9-d00b-483c-a75a-8a6f046868d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:06 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Volume 5c295ade-d025-4e5a-aba5-5217a5855ced: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c295ade-d025-4e5a-aba5-5217a5855ced', 'volume_size': 1} Jul 10 18:24:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:06 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f 1073741824" returned: 0 in 0.850s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:06 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f Jul 10 18:24:06 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:07 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f" returned: 0 in 0.633s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:07 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:24:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.763s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:07 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1713379747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c295ade-d025-4e5a-aba5-5217a5855ced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71711505a3404f58bfd6c3f26600bbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:24:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:24:06Z,use_quota=True,user_id='41d2545118c34059bb133fca72f07126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:24:07 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Creating volume 5c295ade-d025-4e5a-aba5-5217a5855ced {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:24:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:07 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:24:07 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:24:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:07 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:24:07 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:24:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5c295ade-d025-4e5a-aba5-5217a5855ced 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e66e5dc6-1cc4-4308-bd97-386dd90487ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:07 devstack sudo[102549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5c295ade-d025-4e5a-aba5-5217a5855ced 1073741824 Jul 10 18:24:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807e0859-de3c-46cc-acb7-3c4dd7a07aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:07 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:07 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] Volume volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f (a8b01ee5-0de2-43a6-9036-b73c8ca08e2f): created successfully Jul 10 18:24:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (807e0859-de3c-46cc-acb7-3c4dd7a07aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] Flow 'volume_create_manager' (02ccf450-40db-4fae-a568-88884d004441) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:24:07 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-1321453a-b76c-4181-96fe-cf6c95514f81 tempest-VolumesDeleteCascade-1714871339 None] Created volume successfully. Jul 10 18:24:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1f5ecaec-8fc4-422e-8313-007a633f1b25 tempest-VolumesDeleteCascade-1714871339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:08 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5c295ade-d025-4e5a-aba5-5217a5855ced 1073741824" returned: 0 in 0.853s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5c295ade-d025-4e5a-aba5-5217a5855ced {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:08 devstack sudo[102554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5c295ade-d025-4e5a-aba5-5217a5855ced Jul 10 18:24:08 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:08 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5c295ade-d025-4e5a-aba5-5217a5855ced" returned: 0 in 0.630s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:24:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1f5ecaec-8fc4-422e-8313-007a633f1b25 tempest-VolumesDeleteCascade-1714871339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.920s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-1f5ecaec-8fc4-422e-8313-007a633f1b25 tempest-VolumesDeleteCascade-1714871339 None] Creating offline snapshot 84de7990-f10c-4f3b-a5ce-9961bb91fc5b of volume a8b01ee5-0de2-43a6-9036-b73c8ca08e2f {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:24:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5469bfb9-d00b-483c-a75a-8a6f046868d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c295ade-d025-4e5a-aba5-5217a5855ced', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a848e8fd-35cd-4118-b8a3-955b940261ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:08 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[0139ab53-382d-48ce-9e65-a9a564005710]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:24:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1f5ecaec-8fc4-422e-8313-007a633f1b25 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:08 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Volume volume-5c295ade-d025-4e5a-aba5-5217a5855ced (5c295ade-d025-4e5a-aba5-5217a5855ced): created successfully Jul 10 18:24:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a848e8fd-35cd-4118-b8a3-955b940261ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Flow 'volume_create_manager' (33f3351d-b7da-4177-83f4-ef01f4f161ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:24:08 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-0ce115a7-7e62-4cd3-af7a-344abec1fd00 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Created volume successfully. Jul 10 18:24:09 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f Jul 10 18:24:09 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:09 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1f5ecaec-8fc4-422e-8313-007a633f1b25 tempest-VolumesDeleteCascade-1714871339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f" returned: 0 in 0.745s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1f5ecaec-8fc4-422e-8313-007a633f1b25 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f.84de7990-f10c-4f3b-a5ce-9961bb91fc5b 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:09 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f.84de7990-f10c-4f3b-a5ce-9961bb91fc5b 1G Jul 10 18:24:09 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Flow 'volume_create_manager' (d7d6dc31-66aa-484f-8336-17140bc5d56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6b44984-ff4c-4151-917f-7c946cc642e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6b44984-ff4c-4151-917f-7c946cc642e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1622771429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b33fed1-4123-49ab-a079-66088b677bdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71711505a3404f58bfd6c3f26600bbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:24:10Z,use_quota=True,user_id='41d2545118c34059bb133fca72f07126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a9d7cb-556c-46ee-8257-e4e43d0130b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a9d7cb-556c-46ee-8257-e4e43d0130b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1067319-f3c6-49b4-93ec-3b8b5fa81836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1067319-f3c6-49b4-93ec-3b8b5fa81836) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b33fed1-4123-49ab-a079-66088b677bdf', 'volume_name': 'volume-4b33fed1-4123-49ab-a079-66088b677bdf', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca609d8d-36c9-438a-8c61-d764a4ce3bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca609d8d-36c9-438a-8c61-d764a4ce3bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c1d25a-a472-4517-83a9-e18764765c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:10 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Volume 4b33fed1-4123-49ab-a079-66088b677bdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b33fed1-4123-49ab-a079-66088b677bdf', 'volume_size': 1} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Flow 'volume_create_manager' (3f2f312c-4669-42ab-be55-dfc0988666a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2b390a2-d97f-4018-99c5-5a95ff73e61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2b390a2-d97f-4018-99c5-5a95ff73e61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-201610492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b827fff-66ac-4714-80c1-7823d1b5e1cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71711505a3404f58bfd6c3f26600bbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:24:10Z,use_quota=True,user_id='41d2545118c34059bb133fca72f07126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f96d68c-7d0f-4ea3-8adc-be0d8d03bf15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f96d68c-7d0f-4ea3-8adc-be0d8d03bf15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d405534-8a11-4b9b-aac2-36043df07c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d405534-8a11-4b9b-aac2-36043df07c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b827fff-66ac-4714-80c1-7823d1b5e1cc', 'volume_name': 'volume-3b827fff-66ac-4714-80c1-7823d1b5e1cc', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0c594a-f074-4634-9c74-a4b2c076d0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0c594a-f074-4634-9c74-a4b2c076d0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd3267e-15af-4e9e-ac36-fed0faa0b858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:10 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Volume 3b827fff-66ac-4714-80c1-7823d1b5e1cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b827fff-66ac-4714-80c1-7823d1b5e1cc', 'volume_size': 1} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:10 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1f5ecaec-8fc4-422e-8313-007a633f1b25 tempest-VolumesDeleteCascade-1714871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f.84de7990-f10c-4f3b-a5ce-9961bb91fc5b 1G" returned: 0 in 0.957s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1f5ecaec-8fc4-422e-8313-007a633f1b25 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f.84de7990-f10c-4f3b-a5ce-9961bb91fc5b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:10 devstack sudo[102568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f.84de7990-f10c-4f3b-a5ce-9961bb91fc5b Jul 10 18:24:10 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Flow 'volume_create_manager' (36910830-bc42-4dc6-a8a5-237921fa13da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e93ed12-b8ef-40a2-b75b-8284d928230f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e93ed12-b8ef-40a2-b75b-8284d928230f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1393605371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce13cb20-9f49-4fe3-be05-3bdc9997d2ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71711505a3404f58bfd6c3f26600bbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:24:11Z,use_quota=True,user_id='41d2545118c34059bb133fca72f07126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d08ac8-bbec-463d-b1f7-e0f6e38e9939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d08ac8-bbec-463d-b1f7-e0f6e38e9939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a4d25bc-ea52-4111-8b45-b607dd4b9524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a4d25bc-ea52-4111-8b45-b607dd4b9524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce13cb20-9f49-4fe3-be05-3bdc9997d2ed', 'volume_name': 'volume-ce13cb20-9f49-4fe3-be05-3bdc9997d2ed', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ac9510c-90f8-4c8d-8995-953dccccefc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ac9510c-90f8-4c8d-8995-953dccccefc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f831e77b-ba24-4e5d-8f5b-96a15bfe05c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:10 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Volume ce13cb20-9f49-4fe3-be05-3bdc9997d2ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce13cb20-9f49-4fe3-be05-3bdc9997d2ed', 'volume_size': 1} Jul 10 18:24:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:11 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=103,cinder:UPDATE=126,cinder:INSERT=40,cinder:DELETE=12 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:24:11 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=103,cinder:INSERT=25,cinder:UPDATE=147,cinder:DELETE=12 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:24:11 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:24:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Flow 'volume_create_manager' (aeb54abb-6308-49b9-a8cd-1d434e322a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:24:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0bce603-be54-4d5e-bf7e-04d23810aa96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0bce603-be54-4d5e-bf7e-04d23810aa96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-51913201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8494ce4b-10db-4cd3-ac8a-632019ccb5b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71711505a3404f58bfd6c3f26600bbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:24:11Z,use_quota=True,user_id='41d2545118c34059bb133fca72f07126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41619b51-c43b-4d59-b7e9-20aaddf88417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41619b51-c43b-4d59-b7e9-20aaddf88417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b51f14c9-0bab-4827-848e-ad956ba61454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b51f14c9-0bab-4827-848e-ad956ba61454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8494ce4b-10db-4cd3-ac8a-632019ccb5b9', 'volume_name': 'volume-8494ce4b-10db-4cd3-ac8a-632019ccb5b9', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80ba5b89-bf19-45b5-971f-661ec64dc311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80ba5b89-bf19-45b5-971f-661ec64dc311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b83079a5-a33f-4411-9a06-675f36872f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:11 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Volume 8494ce4b-10db-4cd3-ac8a-632019ccb5b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8494ce4b-10db-4cd3-ac8a-632019ccb5b9', 'volume_size': 1} Jul 10 18:24:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:11 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1f5ecaec-8fc4-422e-8313-007a633f1b25 tempest-VolumesDeleteCascade-1714871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f.84de7990-f10c-4f3b-a5ce-9961bb91fc5b" returned: 0 in 0.809s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:11 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-1f5ecaec-8fc4-422e-8313-007a633f1b25 tempest-VolumesDeleteCascade-1714871339 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f.84de7990-f10c-4f3b-a5ce-9961bb91fc5b is being set with open permissions: ugo+rw Jul 10 18:24:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1f5ecaec-8fc4-422e-8313-007a633f1b25 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f.84de7990-f10c-4f3b-a5ce-9961bb91fc5b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:11 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f.84de7990-f10c-4f3b-a5ce-9961bb91fc5b Jul 10 18:24:11 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:11 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:24:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Flow 'volume_create_manager' (0d4bf8bc-cfc5-460c-8d08-1a749ca6f8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:24:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2649d75-ff2e-4fbc-81ee-e2ea793b0492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2649d75-ff2e-4fbc-81ee-e2ea793b0492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1191595111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf6f196f-6458-4550-84d8-45d442a59d54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71711505a3404f58bfd6c3f26600bbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:24:12Z,use_quota=True,user_id='41d2545118c34059bb133fca72f07126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62fc3a0f-af53-4c05-8762-947ec7e85486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62fc3a0f-af53-4c05-8762-947ec7e85486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9e76f4b-9e5f-4fd6-b706-5bc8c8c59cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9e76f4b-9e5f-4fd6-b706-5bc8c8c59cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf6f196f-6458-4550-84d8-45d442a59d54', 'volume_name': 'volume-bf6f196f-6458-4550-84d8-45d442a59d54', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52781f5-d949-4d8d-8fb4-0a332c8aee16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52781f5-d949-4d8d-8fb4-0a332c8aee16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313e9f94-bdf3-4309-8318-db5b8f2c163d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:11 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Volume bf6f196f-6458-4550-84d8-45d442a59d54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf6f196f-6458-4550-84d8-45d442a59d54', 'volume_size': 1} Jul 10 18:24:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:12 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1f5ecaec-8fc4-422e-8313-007a633f1b25 tempest-VolumesDeleteCascade-1714871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f.84de7990-f10c-4f3b-a5ce-9961bb91fc5b" returned: 0 in 0.658s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1f5ecaec-8fc4-422e-8313-007a633f1b25 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:12 devstack sudo[102576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f.info Jul 10 18:24:12 devstack sudo[102576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:12 devstack sudo[102576]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1f5ecaec-8fc4-422e-8313-007a633f1b25 tempest-VolumesDeleteCascade-1714871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f.info" returned: 0 in 0.658s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:12 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-1f5ecaec-8fc4-422e-8313-007a633f1b25 tempest-VolumesDeleteCascade-1714871339 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f.info is being set with open permissions: ugo+rw Jul 10 18:24:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1f5ecaec-8fc4-422e-8313-007a633f1b25 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:12 devstack sudo[102579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f.info Jul 10 18:24:12 devstack sudo[102579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:13 devstack sudo[102579]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1f5ecaec-8fc4-422e-8313-007a633f1b25 tempest-VolumesDeleteCascade-1714871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f.info" returned: 0 in 0.649s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1f5ecaec-8fc4-422e-8313-007a633f1b25 tempest-VolumesDeleteCascade-1714871339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.562s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.291s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:13 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1622771429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b33fed1-4123-49ab-a079-66088b677bdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71711505a3404f58bfd6c3f26600bbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:24:10Z,use_quota=True,user_id='41d2545118c34059bb133fca72f07126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:24:13 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Creating volume 4b33fed1-4123-49ab-a079-66088b677bdf {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:24:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:13 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:24:13 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:24:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:13 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:24:13 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:24:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b33fed1-4123-49ab-a079-66088b677bdf 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:13 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b33fed1-4123-49ab-a079-66088b677bdf 1073741824 Jul 10 18:24:13 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:13 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-1f5ecaec-8fc4-422e-8313-007a633f1b25 tempest-VolumesDeleteCascade-1714871339 None] Create snapshot completed successfully Jul 10 18:24:14 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b33fed1-4123-49ab-a079-66088b677bdf 1073741824" returned: 0 in 0.805s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b33fed1-4123-49ab-a079-66088b677bdf {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:14 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b33fed1-4123-49ab-a079-66088b677bdf Jul 10 18:24:14 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:14 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:24:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Flow 'volume_create_manager' (41d8c591-036a-425f-93c3-8f7aa1f154c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:24:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8bd2b64-0496-4e0b-9067-f52bd2297729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8bd2b64-0496-4e0b-9067-f52bd2297729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:24:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1999827027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a105508e144e6daa9752710d9dff41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=84de7990-f10c-4f3b-a5ce-9961bb91fc5b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:24:15Z,use_quota=True,user_id='78acfa78d71548bd8d408dda70168241',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (802e128f-3e71-4f57-bf34-74092d4751ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (802e128f-3e71-4f57-bf34-74092d4751ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1cae743-6df4-44f5-a47e-0c36d08c792e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1cae743-6df4-44f5-a47e-0c36d08c792e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16', 'volume_name': 'volume-b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16', 'volume_size': 1, 'snapshot_id': '84de7990-f10c-4f3b-a5ce-9961bb91fc5b'}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (852e580b-0f15-4eb0-8ba9-82c65c9bdd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (852e580b-0f15-4eb0-8ba9-82c65c9bdd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d91879e7-0eae-4829-837b-dd0ad3f948ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:14 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Volume b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16', 'volume_size': 1, 'snapshot_id': '84de7990-f10c-4f3b-a5ce-9961bb91fc5b'} Jul 10 18:24:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:15 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b33fed1-4123-49ab-a079-66088b677bdf" returned: 0 in 0.711s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:15 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:24:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.481s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:15 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-201610492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b827fff-66ac-4714-80c1-7823d1b5e1cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71711505a3404f58bfd6c3f26600bbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:24:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:24:10Z,use_quota=True,user_id='41d2545118c34059bb133fca72f07126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:24:15 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Creating volume 3b827fff-66ac-4714-80c1-7823d1b5e1cc {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:24:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:15 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:24:15 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:24:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:15 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:24:15 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:24:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3b827fff-66ac-4714-80c1-7823d1b5e1cc 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:15 devstack sudo[102591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3b827fff-66ac-4714-80c1-7823d1b5e1cc 1073741824 Jul 10 18:24:15 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36c1d25a-a472-4517-83a9-e18764765c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b33fed1-4123-49ab-a079-66088b677bdf', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f88568-89e9-4dc7-ad3f-55c921f30e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:15 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Volume volume-4b33fed1-4123-49ab-a079-66088b677bdf (4b33fed1-4123-49ab-a079-66088b677bdf): created successfully Jul 10 18:24:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f88568-89e9-4dc7-ad3f-55c921f30e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Flow 'volume_create_manager' (d7d6dc31-66aa-484f-8336-17140bc5d56a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:24:15 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-b43a435a-7cfc-443d-88f1-280ce6a497c7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Created volume successfully. Jul 10 18:24:15 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3b827fff-66ac-4714-80c1-7823d1b5e1cc 1073741824" returned: 0 in 0.799s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3b827fff-66ac-4714-80c1-7823d1b5e1cc {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:15 devstack sudo[102597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3b827fff-66ac-4714-80c1-7823d1b5e1cc Jul 10 18:24:15 devstack sudo[102597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:16 devstack sudo[102597]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3b827fff-66ac-4714-80c1-7823d1b5e1cc" returned: 0 in 0.632s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:16 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:24:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.616s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:16 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:24:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1393605371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce13cb20-9f49-4fe3-be05-3bdc9997d2ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71711505a3404f58bfd6c3f26600bbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:24:11Z,use_quota=True,user_id='41d2545118c34059bb133fca72f07126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:24:16 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Creating volume ce13cb20-9f49-4fe3-be05-3bdc9997d2ed {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:24:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:16 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:24:16 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:24:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:16 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:24:16 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:24:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ce13cb20-9f49-4fe3-be05-3bdc9997d2ed 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:16 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ce13cb20-9f49-4fe3-be05-3bdc9997d2ed 1073741824 Jul 10 18:24:16 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd3267e-15af-4e9e-ac36-fed0faa0b858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b827fff-66ac-4714-80c1-7823d1b5e1cc', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32bab0fa-3fe8-43e6-aa4b-f375a98436b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:16 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Volume volume-3b827fff-66ac-4714-80c1-7823d1b5e1cc (3b827fff-66ac-4714-80c1-7823d1b5e1cc): created successfully Jul 10 18:24:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32bab0fa-3fe8-43e6-aa4b-f375a98436b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Flow 'volume_create_manager' (3f2f312c-4669-42ab-be55-dfc0988666a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:24:16 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-cde5aea6-e0f9-4937-88a1-e060d5b04c5f tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Created volume successfully. Jul 10 18:24:17 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ce13cb20-9f49-4fe3-be05-3bdc9997d2ed 1073741824" returned: 0 in 0.789s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ce13cb20-9f49-4fe3-be05-3bdc9997d2ed {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:17 devstack sudo[102606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ce13cb20-9f49-4fe3-be05-3bdc9997d2ed Jul 10 18:24:17 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:17 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ce13cb20-9f49-4fe3-be05-3bdc9997d2ed" returned: 0 in 0.638s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:24:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.654s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-51913201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8494ce4b-10db-4cd3-ac8a-632019ccb5b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71711505a3404f58bfd6c3f26600bbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:24:11Z,use_quota=True,user_id='41d2545118c34059bb133fca72f07126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:24:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Creating volume 8494ce4b-10db-4cd3-ac8a-632019ccb5b9 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:24:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:24:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:24:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:24:17 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:24:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8494ce4b-10db-4cd3-ac8a-632019ccb5b9 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:17 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8494ce4b-10db-4cd3-ac8a-632019ccb5b9 1073741824 Jul 10 18:24:18 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f831e77b-ba24-4e5d-8f5b-96a15bfe05c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce13cb20-9f49-4fe3-be05-3bdc9997d2ed', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f48177cb-3a0d-4fe6-8bd3-0dcc002f9b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:18 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Volume volume-ce13cb20-9f49-4fe3-be05-3bdc9997d2ed (ce13cb20-9f49-4fe3-be05-3bdc9997d2ed): created successfully Jul 10 18:24:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f48177cb-3a0d-4fe6-8bd3-0dcc002f9b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Flow 'volume_create_manager' (36910830-bc42-4dc6-a8a5-237921fa13da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:24:18 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-0fb21248-64d5-4b4a-a4ca-03c2209c7ff3 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Created volume successfully. Jul 10 18:24:18 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8494ce4b-10db-4cd3-ac8a-632019ccb5b9 1073741824" returned: 0 in 0.782s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8494ce4b-10db-4cd3-ac8a-632019ccb5b9 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:18 devstack sudo[102614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8494ce4b-10db-4cd3-ac8a-632019ccb5b9 Jul 10 18:24:18 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:19 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8494ce4b-10db-4cd3-ac8a-632019ccb5b9" returned: 0 in 0.616s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:19 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:24:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.757s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:19 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1191595111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf6f196f-6458-4550-84d8-45d442a59d54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71711505a3404f58bfd6c3f26600bbb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:24:12Z,use_quota=True,user_id='41d2545118c34059bb133fca72f07126',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:24:19 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Creating volume bf6f196f-6458-4550-84d8-45d442a59d54 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:24:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:19 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:24:19 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:24:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:19 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:24:19 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:24:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf6f196f-6458-4550-84d8-45d442a59d54 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b83079a5-a33f-4411-9a06-675f36872f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8494ce4b-10db-4cd3-ac8a-632019ccb5b9', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:19 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf6f196f-6458-4550-84d8-45d442a59d54 1073741824 Jul 10 18:24:19 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b6cff9d-e2d1-4f99-8b02-67dbf9eb366d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:19 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Volume volume-8494ce4b-10db-4cd3-ac8a-632019ccb5b9 (8494ce4b-10db-4cd3-ac8a-632019ccb5b9): created successfully Jul 10 18:24:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b6cff9d-e2d1-4f99-8b02-67dbf9eb366d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Flow 'volume_create_manager' (aeb54abb-6308-49b9-a8cd-1d434e322a5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:24:19 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-ebac6815-c9dd-41ed-bba8-cd67b7a4a35d tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Created volume successfully. Jul 10 18:24:20 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf6f196f-6458-4550-84d8-45d442a59d54 1073741824" returned: 0 in 0.818s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf6f196f-6458-4550-84d8-45d442a59d54 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:20 devstack sudo[102623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf6f196f-6458-4550-84d8-45d442a59d54 Jul 10 18:24:20 devstack sudo[102623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:20 devstack sudo[102623]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf6f196f-6458-4550-84d8-45d442a59d54" returned: 0 in 0.641s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:20 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:24:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.018s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:20 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Acquiring lock "cinder-quobyte-84de7990-f10c-4f3b-a5ce-9961bb91fc5b-b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16" by "_create_volume_from_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:24:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (313e9f94-bdf3-4309-8318-db5b8f2c163d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf6f196f-6458-4550-84d8-45d442a59d54', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6851389b-1b43-427b-a370-fa83905ac5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:20 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-quobyte-84de7990-f10c-4f3b-a5ce-9961bb91fc5b-b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:24:20 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Creating volume b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16 from snapshot 84de7990-f10c-4f3b-a5ce-9961bb91fc5b {{(pid=87399) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 18:24:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:20 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:24:20 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:24:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:20 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:24:20 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Acquiring lock "cinder-quobyte-b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16" by "_copy_volume_from_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:24:20 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-quobyte-b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:24:20 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] snapshot: 84de7990-f10c-4f3b-a5ce-9961bb91fc5b, volume: b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16, {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 18:24:20 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Volume volume-bf6f196f-6458-4550-84d8-45d442a59d54 (bf6f196f-6458-4550-84d8-45d442a59d54): created successfully Jul 10 18:24:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6851389b-1b43-427b-a370-fa83905ac5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Flow 'volume_create_manager' (0d4bf8bc-cfc5-460c-8d08-1a749ca6f8b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:24:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:21 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:24:21 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:24:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:21 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-a4f67e1c-0f89-4ed8-9da6-77db2cd51721 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Created volume successfully. Jul 10 18:24:21 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1eeea63-02a6-4a5e-bd93-ebccdbd1244f]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:24:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f.84de7990-f10c-4f3b-a5ce-9961bb91fc5b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:21 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f.84de7990-f10c-4f3b-a5ce-9961bb91fc5b Jul 10 18:24:21 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:21 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0620c1d3-2665-4dab-8031-ce8a8ac27df7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Acquiring lock "cinder-bf6f196f-6458-4550-84d8-45d442a59d54-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:24:21 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0620c1d3-2665-4dab-8031-ce8a8ac27df7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "cinder-bf6f196f-6458-4550-84d8-45d442a59d54-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:24:21 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0620c1d3-2665-4dab-8031-ce8a8ac27df7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Acquiring lock "cinder-quobyte-bf6f196f-6458-4550-84d8-45d442a59d54" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:24:21 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0620c1d3-2665-4dab-8031-ce8a8ac27df7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "cinder-quobyte-bf6f196f-6458-4550-84d8-45d442a59d54" acquired by "delete_volume" :: waited 0.022s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:24:21 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d3e771-b8ce-4c17-ad51-f3acf00afc77]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:24:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0620c1d3-2665-4dab-8031-ce8a8ac27df7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf6f196f-6458-4550-84d8-45d442a59d54 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:21 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf6f196f-6458-4550-84d8-45d442a59d54 Jul 10 18:24:21 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:21 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f.84de7990-f10c-4f3b-a5ce-9961bb91fc5b" returned: 0 in 0.784s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:21 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:24:21 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] will copy from snapshot at /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 18:24:21 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Creating direct copy from snapshot {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 18:24:21 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2bf1a6-2270-4c69-ab1e-c8f4d3b18892]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:24:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:21 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f Jul 10 18:24:21 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:22 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0620c1d3-2665-4dab-8031-ce8a8ac27df7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf6f196f-6458-4550-84d8-45d442a59d54" returned: 0 in 0.802s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0620c1d3-2665-4dab-8031-ce8a8ac27df7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf6f196f-6458-4550-84d8-45d442a59d54 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:22 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf6f196f-6458-4550-84d8-45d442a59d54 Jul 10 18:24:22 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:22 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f" returned: 0 in 0.743s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:22 devstack cinder-volume[87399]: DEBUG cinder.utils [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Path /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16 not found in is_blk_device check {{(pid=87399) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 18:24:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:22 devstack sudo[102643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16 Jul 10 18:24:22 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:22 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0620c1d3-2665-4dab-8031-ce8a8ac27df7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf6f196f-6458-4550-84d8-45d442a59d54" returned: 0 in 0.653s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:22 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0620c1d3-2665-4dab-8031-ce8a8ac27df7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "cinder-quobyte-bf6f196f-6458-4550-84d8-45d442a59d54" released by "delete_volume" :: held 1.509s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:24:22 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-0620c1d3-2665-4dab-8031-ce8a8ac27df7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Created reservations ['7e40e987-1242-431b-8ed6-894f2cfb47d5', 'f844d4c9-0a8b-41c5-84fc-90cee1dd5f28', '507fbf95-713e-42d7-bc07-d514a89780c6', '945ffc58-a4a0-4721-aa71-285c9dbcdd86'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:24:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0620c1d3-2665-4dab-8031-ce8a8ac27df7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0620c1d3-2665-4dab-8031-ce8a8ac27df7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:23 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0620c1d3-2665-4dab-8031-ce8a8ac27df7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:24:23 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0620c1d3-2665-4dab-8031-ce8a8ac27df7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:24:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0620c1d3-2665-4dab-8031-ce8a8ac27df7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0620c1d3-2665-4dab-8031-ce8a8ac27df7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:23 devstack sudo[102646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:24:23 devstack sudo[102646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:23 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4b96ff69-2545-48ad-a33b-15bb5b70e72a tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Acquiring lock "cinder-8494ce4b-10db-4cd3-ac8a-632019ccb5b9-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:24:23 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4b96ff69-2545-48ad-a33b-15bb5b70e72a tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "cinder-8494ce4b-10db-4cd3-ac8a-632019ccb5b9-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:24:23 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4b96ff69-2545-48ad-a33b-15bb5b70e72a tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Acquiring lock "cinder-quobyte-8494ce4b-10db-4cd3-ac8a-632019ccb5b9" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:24:23 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4b96ff69-2545-48ad-a33b-15bb5b70e72a tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "cinder-quobyte-8494ce4b-10db-4cd3-ac8a-632019ccb5b9" acquired by "delete_volume" :: waited 0.023s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:24:23 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3de6a94-47c6-4290-a4b5-7c127e77c396]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:24:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4b96ff69-2545-48ad-a33b-15bb5b70e72a tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8494ce4b-10db-4cd3-ac8a-632019ccb5b9 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:24 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8494ce4b-10db-4cd3-ac8a-632019ccb5b9 Jul 10 18:24:24 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:24 devstack sudo[102646]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0620c1d3-2665-4dab-8031-ce8a8ac27df7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.192s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:24 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-0620c1d3-2665-4dab-8031-ce8a8ac27df7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:24:24 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-0620c1d3-2665-4dab-8031-ce8a8ac27df7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Deleted volume successfully. Jul 10 18:24:24 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0620c1d3-2665-4dab-8031-ce8a8ac27df7 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "cinder-bf6f196f-6458-4550-84d8-45d442a59d54-delete_volume" released by "delete_volume" :: held 2.973s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:24:25 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4b96ff69-2545-48ad-a33b-15bb5b70e72a tempest-CreateVolumesFromSourceVolumeTest-920035057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8494ce4b-10db-4cd3-ac8a-632019ccb5b9" returned: 0 in 1.383s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4b96ff69-2545-48ad-a33b-15bb5b70e72a tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8494ce4b-10db-4cd3-ac8a-632019ccb5b9 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:25 devstack sudo[102666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8494ce4b-10db-4cd3-ac8a-632019ccb5b9 Jul 10 18:24:25 devstack sudo[102666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:26 devstack sudo[102666]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4b96ff69-2545-48ad-a33b-15bb5b70e72a tempest-CreateVolumesFromSourceVolumeTest-920035057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8494ce4b-10db-4cd3-ac8a-632019ccb5b9" returned: 0 in 1.578s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:26 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4b96ff69-2545-48ad-a33b-15bb5b70e72a tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "cinder-quobyte-8494ce4b-10db-4cd3-ac8a-632019ccb5b9" released by "delete_volume" :: held 3.048s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:24:26 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-4b96ff69-2545-48ad-a33b-15bb5b70e72a tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Created reservations ['ba2d0e60-7968-4600-9cb6-12a5c79d28e2', '6665f12d-c163-49d8-82ff-db6e46c9a01e', '557e5eb9-bbc1-4c22-9954-ea97d1ad878f', '2f19307f-9ab4-479f-ad70-d06f768b92ed'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:24:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4b96ff69-2545-48ad-a33b-15bb5b70e72a tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4b96ff69-2545-48ad-a33b-15bb5b70e72a tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:27 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-4b96ff69-2545-48ad-a33b-15bb5b70e72a tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:24:27 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-4b96ff69-2545-48ad-a33b-15bb5b70e72a tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:24:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4b96ff69-2545-48ad-a33b-15bb5b70e72a tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4b96ff69-2545-48ad-a33b-15bb5b70e72a tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:27 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:24:27 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:27 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ab4ea826-dfc5-4659-9fdf-ad7b0754da64 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Acquiring lock "cinder-ce13cb20-9f49-4fe3-be05-3bdc9997d2ed-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:24:27 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ab4ea826-dfc5-4659-9fdf-ad7b0754da64 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "cinder-ce13cb20-9f49-4fe3-be05-3bdc9997d2ed-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:24:27 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ab4ea826-dfc5-4659-9fdf-ad7b0754da64 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Acquiring lock "cinder-quobyte-ce13cb20-9f49-4fe3-be05-3bdc9997d2ed" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:24:27 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ab4ea826-dfc5-4659-9fdf-ad7b0754da64 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "cinder-quobyte-ce13cb20-9f49-4fe3-be05-3bdc9997d2ed" acquired by "delete_volume" :: waited 0.036s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:24:27 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[687fc37f-06b2-4821-80c2-65c9235e8537]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:24:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ab4ea826-dfc5-4659-9fdf-ad7b0754da64 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ce13cb20-9f49-4fe3-be05-3bdc9997d2ed {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:27 devstack sudo[102672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ce13cb20-9f49-4fe3-be05-3bdc9997d2ed Jul 10 18:24:27 devstack sudo[102672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:27 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16" returned: 0 in 5.327s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:27 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[9796ea46-5f7d-465e-9b77-00780b70a6d9]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:24:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:28 devstack sudo[102675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f Jul 10 18:24:28 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:28 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4b96ff69-2545-48ad-a33b-15bb5b70e72a tempest-CreateVolumesFromSourceVolumeTest-920035057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.909s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:28 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-4b96ff69-2545-48ad-a33b-15bb5b70e72a tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:24:28 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-4b96ff69-2545-48ad-a33b-15bb5b70e72a tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Deleted volume successfully. Jul 10 18:24:28 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4b96ff69-2545-48ad-a33b-15bb5b70e72a tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "cinder-8494ce4b-10db-4cd3-ac8a-632019ccb5b9-delete_volume" released by "delete_volume" :: held 4.362s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:24:28 devstack sudo[102672]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ab4ea826-dfc5-4659-9fdf-ad7b0754da64 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ce13cb20-9f49-4fe3-be05-3bdc9997d2ed" returned: 0 in 0.886s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ab4ea826-dfc5-4659-9fdf-ad7b0754da64 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ce13cb20-9f49-4fe3-be05-3bdc9997d2ed {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:28 devstack sudo[102680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ce13cb20-9f49-4fe3-be05-3bdc9997d2ed Jul 10 18:24:28 devstack sudo[102680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:28 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f" returned: 0 in 0.912s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:28 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Image conversion details: src /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f, size 1024.00 MB, duration 5.33 sec, destination /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16 {{(pid=87399) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 18:24:28 devstack cinder-volume[87399]: INFO cinder.image.image_utils [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Converted 1024.00 MB image at 192.16 MB/s Jul 10 18:24:28 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16 is being set with open permissions: ugo+rw Jul 10 18:24:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:28 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16 Jul 10 18:24:28 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:29 devstack sudo[102680]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ab4ea826-dfc5-4659-9fdf-ad7b0754da64 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ce13cb20-9f49-4fe3-be05-3bdc9997d2ed" returned: 0 in 0.650s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ab4ea826-dfc5-4659-9fdf-ad7b0754da64 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "cinder-quobyte-ce13cb20-9f49-4fe3-be05-3bdc9997d2ed" released by "delete_volume" :: held 1.638s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:24:29 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-ab4ea826-dfc5-4659-9fdf-ad7b0754da64 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Created reservations ['5ada289f-c0f5-4667-b365-1fa2a83762f4', '19fb8ebf-8a92-41ae-beb7-9b248849f84e', '49e6f643-fe1b-4ac3-a429-a2b6b9772807', 'a3ba4813-3435-448b-975a-f25703a48acb'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:24:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ab4ea826-dfc5-4659-9fdf-ad7b0754da64 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ab4ea826-dfc5-4659-9fdf-ad7b0754da64 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ab4ea826-dfc5-4659-9fdf-ad7b0754da64 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:24:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ab4ea826-dfc5-4659-9fdf-ad7b0754da64 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:24:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ab4ea826-dfc5-4659-9fdf-ad7b0754da64 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ab4ea826-dfc5-4659-9fdf-ad7b0754da64 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:29 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:24:29 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:29 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16" returned: 0 in 0.649s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-quobyte-b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16" released by "_copy_volume_from_snapshot" :: held 8.529s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:24:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-quobyte-84de7990-f10c-4f3b-a5ce-9961bb91fc5b-b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16" released by "_create_volume_from_snapshot" :: held 8.565s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:24:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.601s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d91879e7-0eae-4829-837b-dd0ad3f948ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16', 'volume_size': 1, 'snapshot_id': '84de7990-f10c-4f3b-a5ce-9961bb91fc5b'}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e9d828-c7ad-4972-9c88-631026e474d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:29 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Volume volume-b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16 (b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16): created successfully Jul 10 18:24:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82e9d828-c7ad-4972-9c88-631026e474d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Flow 'volume_create_manager' (41d8c591-036a-425f-93c3-8f7aa1f154c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:24:29 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-88f92a9c-e2b3-4ed7-8b0f-c980baa84bcd tempest-VolumesDeleteCascade-1714871339 None] Created volume successfully. Jul 10 18:24:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3c21c669-a7d1-4fad-8782-6f573aca4535 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Acquiring lock "cinder-3b827fff-66ac-4714-80c1-7823d1b5e1cc-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:24:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3c21c669-a7d1-4fad-8782-6f573aca4535 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "cinder-3b827fff-66ac-4714-80c1-7823d1b5e1cc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:24:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3c21c669-a7d1-4fad-8782-6f573aca4535 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Acquiring lock "cinder-quobyte-3b827fff-66ac-4714-80c1-7823d1b5e1cc" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:24:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3c21c669-a7d1-4fad-8782-6f573aca4535 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "cinder-quobyte-3b827fff-66ac-4714-80c1-7823d1b5e1cc" acquired by "delete_volume" :: waited 0.020s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:24:29 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29d91b7-d6d8-4942-913c-3892ceef46e1]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:24:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3c21c669-a7d1-4fad-8782-6f573aca4535 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3b827fff-66ac-4714-80c1-7823d1b5e1cc {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:29 devstack sudo[102691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3b827fff-66ac-4714-80c1-7823d1b5e1cc Jul 10 18:24:29 devstack sudo[102691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:29 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ab4ea826-dfc5-4659-9fdf-ad7b0754da64 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.669s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:29 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-ab4ea826-dfc5-4659-9fdf-ad7b0754da64 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:24:29 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-ab4ea826-dfc5-4659-9fdf-ad7b0754da64 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Deleted volume successfully. Jul 10 18:24:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Acquiring lock "cinder-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:24:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ab4ea826-dfc5-4659-9fdf-ad7b0754da64 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "cinder-ce13cb20-9f49-4fe3-be05-3bdc9997d2ed-delete_volume" released by "delete_volume" :: held 2.613s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:24:30 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:24:30 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Performing cascade delete. {{(pid=87399) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 10 18:24:30 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Acquiring lock "cinder-84de7990-f10c-4f3b-a5ce-9961bb91fc5b-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:24:30 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-84de7990-f10c-4f3b-a5ce-9961bb91fc5b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:24:30 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Acquiring lock "cinder-quobyte-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:24:30 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-quobyte-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:24:30 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Acquiring lock "cinder-quobyte-84de7990-f10c-4f3b-a5ce-9961bb91fc5b" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:24:30 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-quobyte-84de7990-f10c-4f3b-a5ce-9961bb91fc5b" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:24:30 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Deleting offline snapshot 84de7990-f10c-4f3b-a5ce-9961bb91fc5b of volume a8b01ee5-0de2-43a6-9036-b73c8ca08e2f {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:24:30 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] snapshot_file for this snap is: volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f.84de7990-f10c-4f3b-a5ce-9961bb91fc5b {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:24:30 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1a2a1d-dd45-4d5c-9292-ef087b6662d7]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:24:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f.84de7990-f10c-4f3b-a5ce-9961bb91fc5b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:30 devstack sudo[102694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f.84de7990-f10c-4f3b-a5ce-9961bb91fc5b Jul 10 18:24:30 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:30 devstack sudo[102691]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3c21c669-a7d1-4fad-8782-6f573aca4535 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3b827fff-66ac-4714-80c1-7823d1b5e1cc" returned: 0 in 0.777s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3c21c669-a7d1-4fad-8782-6f573aca4535 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3b827fff-66ac-4714-80c1-7823d1b5e1cc {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:30 devstack sudo[102699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3b827fff-66ac-4714-80c1-7823d1b5e1cc Jul 10 18:24:30 devstack sudo[102699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:30 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f.84de7990-f10c-4f3b-a5ce-9961bb91fc5b" returned: 0 in 0.782s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:30 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:24:30 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f31882-f308-4d9b-83c2-376c275bce87]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:24:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:31 devstack sudo[102704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f Jul 10 18:24:31 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:31 devstack sudo[102699]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3c21c669-a7d1-4fad-8782-6f573aca4535 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3b827fff-66ac-4714-80c1-7823d1b5e1cc" returned: 0 in 0.623s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:31 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3c21c669-a7d1-4fad-8782-6f573aca4535 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "cinder-quobyte-3b827fff-66ac-4714-80c1-7823d1b5e1cc" released by "delete_volume" :: held 1.436s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:24:31 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-3c21c669-a7d1-4fad-8782-6f573aca4535 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Created reservations ['e4670e15-9699-4c53-a3fe-bc54d1a794a2', 'aebf8f9e-edf8-4ef6-b7aa-b4f0f44a530c', '9046560d-af2f-4a32-bfa9-8d7a26e730bd', '8172e71d-7220-4e26-a837-118ce00c9e49'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:24:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3c21c669-a7d1-4fad-8782-6f573aca4535 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3c21c669-a7d1-4fad-8782-6f573aca4535 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:31 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-3c21c669-a7d1-4fad-8782-6f573aca4535 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:24:31 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-3c21c669-a7d1-4fad-8782-6f573aca4535 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:24:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3c21c669-a7d1-4fad-8782-6f573aca4535 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3c21c669-a7d1-4fad-8782-6f573aca4535 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:31 devstack sudo[102707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:24:31 devstack sudo[102707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:31 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f" returned: 0 in 0.743s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f.84de7990-f10c-4f3b-a5ce-9961bb91fc5b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:31 devstack sudo[102712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f.84de7990-f10c-4f3b-a5ce-9961bb91fc5b Jul 10 18:24:31 devstack sudo[102712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:31 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-69aaf9a4-e5a7-43e7-aebb-c6ebefae1dd6 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Acquiring lock "cinder-4b33fed1-4123-49ab-a079-66088b677bdf-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:24:31 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-69aaf9a4-e5a7-43e7-aebb-c6ebefae1dd6 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "cinder-4b33fed1-4123-49ab-a079-66088b677bdf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:24:31 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-69aaf9a4-e5a7-43e7-aebb-c6ebefae1dd6 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Acquiring lock "cinder-quobyte-4b33fed1-4123-49ab-a079-66088b677bdf" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:24:31 devstack sudo[102707]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:31 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-69aaf9a4-e5a7-43e7-aebb-c6ebefae1dd6 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "cinder-quobyte-4b33fed1-4123-49ab-a079-66088b677bdf" acquired by "delete_volume" :: waited 0.023s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:24:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3c21c669-a7d1-4fad-8782-6f573aca4535 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.724s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:32 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-3c21c669-a7d1-4fad-8782-6f573aca4535 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:24:32 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-3c21c669-a7d1-4fad-8782-6f573aca4535 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Deleted volume successfully. Jul 10 18:24:32 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5a7aad-a6a1-4efd-9738-8422011807f1]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:24:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-69aaf9a4-e5a7-43e7-aebb-c6ebefae1dd6 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b33fed1-4123-49ab-a079-66088b677bdf {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:32 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3c21c669-a7d1-4fad-8782-6f573aca4535 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "cinder-3b827fff-66ac-4714-80c1-7823d1b5e1cc-delete_volume" released by "delete_volume" :: held 2.370s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:24:32 devstack sudo[102715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b33fed1-4123-49ab-a079-66088b677bdf Jul 10 18:24:32 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:32 devstack sudo[102712]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f.84de7990-f10c-4f3b-a5ce-9961bb91fc5b" returned: 0 in 0.765s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f.84de7990-f10c-4f3b-a5ce-9961bb91fc5b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:32 devstack sudo[102720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f.84de7990-f10c-4f3b-a5ce-9961bb91fc5b Jul 10 18:24:32 devstack sudo[102720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:32 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-69aaf9a4-e5a7-43e7-aebb-c6ebefae1dd6 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b33fed1-4123-49ab-a079-66088b677bdf" returned: 0 in 0.788s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-69aaf9a4-e5a7-43e7-aebb-c6ebefae1dd6 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b33fed1-4123-49ab-a079-66088b677bdf {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:32 devstack sudo[102725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b33fed1-4123-49ab-a079-66088b677bdf Jul 10 18:24:32 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:33 devstack sudo[102720]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f.84de7990-f10c-4f3b-a5ce-9961bb91fc5b" returned: 0 in 0.663s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:33 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-quobyte-84de7990-f10c-4f3b-a5ce-9961bb91fc5b" released by "_delete_snapshot" :: held 3.051s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:24:33 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-quobyte-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f" released by "delete_snapshot" :: held 3.076s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:24:33 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Created reservations ['84e0f270-0623-471c-aaae-e5bf6768ddab', '7aadcd1d-6a4a-4d91-a786-010aa2571ca2', '75dd6d0d-fc02-48e2-95ef-b977ba0cad6b', 'd8519218-c818-4823-9c2c-af086f8484b4'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:24:33 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Delete snapshot completed successfully. Jul 10 18:24:33 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-84de7990-f10c-4f3b-a5ce-9961bb91fc5b-delete_snapshot" released by "delete_snapshot" :: held 3.277s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:24:33 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Snapshots deleted, issuing volume delete {{(pid=87399) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 10 18:24:33 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Acquiring lock "cinder-quobyte-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:24:33 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-quobyte-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f" acquired by "delete_volume" :: waited 0.016s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:24:33 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba5b7501-bf00-4ee3-88c8-25c20d816df1]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:24:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:33 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-69aaf9a4-e5a7-43e7-aebb-c6ebefae1dd6 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4b33fed1-4123-49ab-a079-66088b677bdf" returned: 0 in 0.676s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:33 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-69aaf9a4-e5a7-43e7-aebb-c6ebefae1dd6 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "cinder-quobyte-4b33fed1-4123-49ab-a079-66088b677bdf" released by "delete_volume" :: held 1.514s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:24:33 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f Jul 10 18:24:33 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:33 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-69aaf9a4-e5a7-43e7-aebb-c6ebefae1dd6 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Created reservations ['480b2b35-11b7-43f9-a07b-ce0ebe442e47', 'caa1e352-5ef0-4101-b0bd-0cdbd7f90e7e', '943142fe-8cbd-49da-9f33-198fa67e9d65', 'b027a8bb-2cb6-4094-817f-a0783b49ba59'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:24:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-69aaf9a4-e5a7-43e7-aebb-c6ebefae1dd6 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-69aaf9a4-e5a7-43e7-aebb-c6ebefae1dd6 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:33 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-69aaf9a4-e5a7-43e7-aebb-c6ebefae1dd6 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:24:33 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-69aaf9a4-e5a7-43e7-aebb-c6ebefae1dd6 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:24:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-69aaf9a4-e5a7-43e7-aebb-c6ebefae1dd6 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-69aaf9a4-e5a7-43e7-aebb-c6ebefae1dd6 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:33 devstack sudo[102731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:24:33 devstack sudo[102731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:34 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-de845577-75e4-46ba-8e14-1bbbcdcb0a12 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Acquiring lock "cinder-5c295ade-d025-4e5a-aba5-5217a5855ced-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:24:34 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-de845577-75e4-46ba-8e14-1bbbcdcb0a12 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "cinder-5c295ade-d025-4e5a-aba5-5217a5855ced-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:24:34 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f" returned: 0 in 0.782s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:34 devstack sudo[102737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f Jul 10 18:24:34 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:34 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-de845577-75e4-46ba-8e14-1bbbcdcb0a12 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Acquiring lock "cinder-quobyte-5c295ade-d025-4e5a-aba5-5217a5855ced" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:24:34 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-de845577-75e4-46ba-8e14-1bbbcdcb0a12 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "cinder-quobyte-5c295ade-d025-4e5a-aba5-5217a5855ced" acquired by "delete_volume" :: waited 0.033s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:24:34 devstack sudo[102731]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-69aaf9a4-e5a7-43e7-aebb-c6ebefae1dd6 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.702s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:34 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-69aaf9a4-e5a7-43e7-aebb-c6ebefae1dd6 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:24:34 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-69aaf9a4-e5a7-43e7-aebb-c6ebefae1dd6 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Deleted volume successfully. Jul 10 18:24:34 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9f9409-41ac-4556-a25a-56a768f0c007]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:24:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-de845577-75e4-46ba-8e14-1bbbcdcb0a12 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5c295ade-d025-4e5a-aba5-5217a5855ced {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:34 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-69aaf9a4-e5a7-43e7-aebb-c6ebefae1dd6 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "cinder-4b33fed1-4123-49ab-a079-66088b677bdf-delete_volume" released by "delete_volume" :: held 2.454s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:24:34 devstack sudo[102740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5c295ade-d025-4e5a-aba5-5217a5855ced Jul 10 18:24:34 devstack sudo[102740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:34 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f" returned: 0 in 0.719s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:34 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-quobyte-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f" released by "delete_volume" :: held 1.566s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:24:34 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Created reservations ['4010b8bd-d7df-4f90-bf79-f579f6795ab7', '7de66569-6d2b-471b-a98b-7457d50737be', 'd1bd5780-a872-4d94-b22a-042b9ccc2ec3', 'b07ab3e6-a873-4ef0-a29d-f4271e0a5f49'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:24:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:24:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:24:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:35 devstack sudo[102747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:24:35 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:35 devstack sudo[102740]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-de845577-75e4-46ba-8e14-1bbbcdcb0a12 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5c295ade-d025-4e5a-aba5-5217a5855ced" returned: 0 in 0.814s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-de845577-75e4-46ba-8e14-1bbbcdcb0a12 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5c295ade-d025-4e5a-aba5-5217a5855ced {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:35 devstack sudo[102749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5c295ade-d025-4e5a-aba5-5217a5855ced Jul 10 18:24:35 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:35 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5153b4dc-04f8-4a80-ac5a-d402d4f83493 tempest-VolumesDeleteCascade-1714871339 None] Acquiring lock "cinder-b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:24:35 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5153b4dc-04f8-4a80-ac5a-d402d4f83493 tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:24:35 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5153b4dc-04f8-4a80-ac5a-d402d4f83493 tempest-VolumesDeleteCascade-1714871339 None] Acquiring lock "cinder-quobyte-b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:24:35 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5153b4dc-04f8-4a80-ac5a-d402d4f83493 tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-quobyte-b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16" acquired by "delete_volume" :: waited 0.018s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:24:35 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[579a8844-7114-4aca-bdc2-d36bc69a051b]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:24:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5153b4dc-04f8-4a80-ac5a-d402d4f83493 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:35 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.674s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:35 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:24:35 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Deleted volume successfully. Jul 10 18:24:35 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0f8d9943-5865-4e5c-ab38-8763d5635329 tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-a8b01ee5-0de2-43a6-9036-b73c8ca08e2f-delete_volume" released by "delete_volume" :: held 5.757s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:24:35 devstack sudo[102752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16 Jul 10 18:24:35 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:35 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-de845577-75e4-46ba-8e14-1bbbcdcb0a12 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-5c295ade-d025-4e5a-aba5-5217a5855ced" returned: 0 in 0.743s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:35 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-de845577-75e4-46ba-8e14-1bbbcdcb0a12 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "cinder-quobyte-5c295ade-d025-4e5a-aba5-5217a5855ced" released by "delete_volume" :: held 1.612s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:24:35 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-de845577-75e4-46ba-8e14-1bbbcdcb0a12 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Created reservations ['ddc40574-eab0-4514-8129-4dcb568de10a', '65507fda-2ef6-41cb-a58a-c3f3d19f4d70', 'e6adbfb5-fccc-4d87-818f-02b6b4b01fa7', '6b04662d-f9d4-4e78-a381-228b84520d03'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:24:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-de845577-75e4-46ba-8e14-1bbbcdcb0a12 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-de845577-75e4-46ba-8e14-1bbbcdcb0a12 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-de845577-75e4-46ba-8e14-1bbbcdcb0a12 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:24:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-de845577-75e4-46ba-8e14-1bbbcdcb0a12 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:24:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-de845577-75e4-46ba-8e14-1bbbcdcb0a12 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-de845577-75e4-46ba-8e14-1bbbcdcb0a12 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:36 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:24:36 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:36 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5153b4dc-04f8-4a80-ac5a-d402d4f83493 tempest-VolumesDeleteCascade-1714871339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16" returned: 0 in 0.767s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5153b4dc-04f8-4a80-ac5a-d402d4f83493 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:36 devstack sudo[102761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16 Jul 10 18:24:36 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:36 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-de845577-75e4-46ba-8e14-1bbbcdcb0a12 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.670s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:36 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-de845577-75e4-46ba-8e14-1bbbcdcb0a12 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:24:36 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-de845577-75e4-46ba-8e14-1bbbcdcb0a12 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Deleted volume successfully. Jul 10 18:24:36 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-de845577-75e4-46ba-8e14-1bbbcdcb0a12 tempest-CreateVolumesFromSourceVolumeTest-920035057 None] Lock "cinder-5c295ade-d025-4e5a-aba5-5217a5855ced-delete_volume" released by "delete_volume" :: held 2.564s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:24:37 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5153b4dc-04f8-4a80-ac5a-d402d4f83493 tempest-VolumesDeleteCascade-1714871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16" returned: 0 in 0.667s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:37 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5153b4dc-04f8-4a80-ac5a-d402d4f83493 tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-quobyte-b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16" released by "delete_volume" :: held 1.480s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:24:37 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-5153b4dc-04f8-4a80-ac5a-d402d4f83493 tempest-VolumesDeleteCascade-1714871339 None] Created reservations ['d2bdd2db-cdfd-4694-93ae-23fdb4320ca1', '019d9f68-f6d5-4112-8952-2bf3c5d40c21', 'a2241561-4ffe-4ffc-9cad-a93677667347', '3182cd45-095d-4ae0-81e1-956598f255e5'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:24:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5153b4dc-04f8-4a80-ac5a-d402d4f83493 tempest-VolumesDeleteCascade-1714871339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5153b4dc-04f8-4a80-ac5a-d402d4f83493 tempest-VolumesDeleteCascade-1714871339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:37 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5153b4dc-04f8-4a80-ac5a-d402d4f83493 tempest-VolumesDeleteCascade-1714871339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:24:37 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5153b4dc-04f8-4a80-ac5a-d402d4f83493 tempest-VolumesDeleteCascade-1714871339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:24:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5153b4dc-04f8-4a80-ac5a-d402d4f83493 tempest-VolumesDeleteCascade-1714871339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5153b4dc-04f8-4a80-ac5a-d402d4f83493 tempest-VolumesDeleteCascade-1714871339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:37 devstack sudo[102765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:24:37 devstack sudo[102765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:37 devstack sudo[102765]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5153b4dc-04f8-4a80-ac5a-d402d4f83493 tempest-VolumesDeleteCascade-1714871339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.690s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:37 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-5153b4dc-04f8-4a80-ac5a-d402d4f83493 tempest-VolumesDeleteCascade-1714871339 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:24:37 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-5153b4dc-04f8-4a80-ac5a-d402d4f83493 tempest-VolumesDeleteCascade-1714871339 None] Deleted volume successfully. Jul 10 18:24:38 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5153b4dc-04f8-4a80-ac5a-d402d4f83493 tempest-VolumesDeleteCascade-1714871339 None] Lock "cinder-b9e0d25c-7c0f-4eee-ac3d-b51d1559bb16-delete_volume" released by "delete_volume" :: held 2.395s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:24:40 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:24:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] Flow 'volume_create_manager' (66ae60c7-98f6-4205-9e10-9f6fc9911c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:24:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2225403c-ea4e-4de6-8252-bd5344aa53b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2225403c-ea4e-4de6-8252-bd5344aa53b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1635345351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f976f7-4270-44cd-9d30-ecac8b4c3b9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61b5c28f9a3e404ca495c88575d5c7fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:24:41Z,use_quota=True,user_id='6d9a497d13c540b0b963a21bb6832a97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f7f704e-1800-42c7-9865-12cedda616e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f7f704e-1800-42c7-9865-12cedda616e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ae01c3-27a9-4c05-87de-cbc92c240759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ae01c3-27a9-4c05-87de-cbc92c240759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6f976f7-4270-44cd-9d30-ecac8b4c3b9f', 'volume_name': 'volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (230443c0-db57-42b3-9623-1cc1107731bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (230443c0-db57-42b3-9623-1cc1107731bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b5641d-e0c4-4bd8-b64a-67ca83ae8d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:40 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] Volume c6f976f7-4270-44cd-9d30-ecac8b4c3b9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f', 'volume_size': 1} Jul 10 18:24:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:40 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:24:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1635345351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f976f7-4270-44cd-9d30-ecac8b4c3b9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61b5c28f9a3e404ca495c88575d5c7fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:24:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:24:41Z,use_quota=True,user_id='6d9a497d13c540b0b963a21bb6832a97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:24:40 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] Creating volume c6f976f7-4270-44cd-9d30-ecac8b4c3b9f {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:24:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:40 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:24:40 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:24:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:40 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:24:40 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:24:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:40 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f 1073741824 Jul 10 18:24:40 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:41 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f 1073741824" returned: 0 in 0.852s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:41 devstack sudo[102774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f Jul 10 18:24:41 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:41 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:24:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Flow 'volume_create_manager' (4dfd3a08-b85b-409f-a9fb-8157629d4328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:24:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d5716f4-257d-4493-a16e-5ce10efa588c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d5716f4-257d-4493-a16e-5ce10efa588c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e90aa4e-75ea-4d23-a9e1-395880dded22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5ca1f83163245ea9202ecc7a5e92723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:24:42Z,use_quota=True,user_id='f4d677218f574723916991e8b7381217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (448aba7a-e4cd-4717-b185-e0611d89f803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (448aba7a-e4cd-4717-b185-e0611d89f803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09099a0-4b8e-47cc-b479-e119e449faf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:42 devstack cinder-volume[87399]: DEBUG cinder.image.glance [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Creating Keystone auth plugin from conf {{(pid=87399) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 18:24:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09099a0-4b8e-47cc-b479-e119e449faf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1e90aa4e-75ea-4d23-a9e1-395880dded22', 'volume_name': 'volume-1e90aa4e-75ea-4d23-a9e1-395880dded22', 'volume_size': 1, 'image_id': '02e53a22-34ae-431b-aea0-4c5a1142842d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02e53a22-34ae-431b-aea0-4c5a1142842d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f2be1472d7fc6ed912f7eeeeed03d223', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f5ca1f83163245ea9202ecc7a5e92723', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b582966232ef1ffde7f4a25893c63c77582834d98b7c473ea46b370bcc92e91395e17d6309eb7db2eabe438ec430199c6f89cdd7543a90445c22c5c4b3b9b463', 'id': '02e53a22-34ae-431b-aea0-4c5a1142842d', 'created_at': datetime.datetime(2026, 7, 10, 16, 24, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 16, 24, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02e53a22-34ae-431b-aea0-4c5a1142842d/file', 'properties': {}}, 'image_service': }' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (049c638f-b781-47f8-b7bb-8ae4dd33c6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (049c638f-b781-47f8-b7bb-8ae4dd33c6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51e46a3c-34aa-46ca-9b5d-554561bb3829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:42 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Volume 1e90aa4e-75ea-4d23-a9e1-395880dded22: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1e90aa4e-75ea-4d23-a9e1-395880dded22', 'volume_size': 1, 'image_id': '02e53a22-34ae-431b-aea0-4c5a1142842d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02e53a22-34ae-431b-aea0-4c5a1142842d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f2be1472d7fc6ed912f7eeeeed03d223', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f5ca1f83163245ea9202ecc7a5e92723', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b582966232ef1ffde7f4a25893c63c77582834d98b7c473ea46b370bcc92e91395e17d6309eb7db2eabe438ec430199c6f89cdd7543a90445c22c5c4b3b9b463', 'id': '02e53a22-34ae-431b-aea0-4c5a1142842d', 'created_at': datetime.datetime(2026, 7, 10, 16, 24, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 16, 24, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02e53a22-34ae-431b-aea0-4c5a1142842d/file', 'properties': {}}, 'image_service': } Jul 10 18:24:42 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Trying to clone 1e90aa4e-75ea-4d23-a9e1-395880dded22 from image 02e53a22-34ae-431b-aea0-4c5a1142842d at location (None, [{'url': 'file:///opt/stack/data/glance/images/02e53a22-34ae-431b-aea0-4c5a1142842d', 'metadata': {}}]). {{(pid=87399) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 18:24:42 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_02e53a22-34ae-431b-aea0-4c5a1142842d_r_oskbqrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87399) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 18:24:42 devstack cinder-volume[87399]: INFO cinder.image.image_utils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Image download 0.00 MB at 0.00 MB/s Jul 10 18:24:42 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f" returned: 0 in 0.657s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:42 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:24:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b5641d-e0c4-4bd8-b64a-67ca83ae8d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bf7a56-00ef-41f0-9a7d-f0e7ee98dac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:42 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cf04c8-915e-417e-9c19-58374a981403]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:24:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02e53a22-34ae-431b-aea0-4c5a1142842d_r_oskbqrdevstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:42 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] Volume volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f (c6f976f7-4270-44cd-9d30-ecac8b4c3b9f): created successfully Jul 10 18:24:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bf7a56-00ef-41f0-9a7d-f0e7ee98dac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] Flow 'volume_create_manager' (66ae60c7-98f6-4205-9e10-9f6fc9911c82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:24:42 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-f4cd201e-7daf-4494-9b26-964a3c29e08f tempest-VolumesCloneTest-229752678 None] Created volume successfully. Jul 10 18:24:42 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02e53a22-34ae-431b-aea0-4c5a1142842d_r_oskbqrdevstack@QuobyteHD Jul 10 18:24:42 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:43 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02e53a22-34ae-431b-aea0-4c5a1142842d_r_oskbqrdevstack@QuobyteHD" returned: 0 in 0.757s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02e53a22-34ae-431b-aea0-4c5a1142842d_r_oskbqrdevstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:43 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:24:43 devstack sudo[102781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02e53a22-34ae-431b-aea0-4c5a1142842d_r_oskbqrdevstack@QuobyteHD Jul 10 18:24:43 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Flow 'volume_create_manager' (10b15c9b-a57f-4b75-8a6c-f001410c51fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:24:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ad4a05-64cf-42c3-b500-2ee5e741c52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ad4a05-64cf-42c3-b500-2ee5e741c52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2115969369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6984307e-8f8a-439f-982e-a019b820aa0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61b5c28f9a3e404ca495c88575d5c7fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:24:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=c6f976f7-4270-44cd-9d30-ecac8b4c3b9f,status='creating',terminated_at=None,updated_at=2026-07-10T16:24:43Z,use_quota=True,user_id='6d9a497d13c540b0b963a21bb6832a97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f38b193-ddd1-4c45-a17a-9f7b07e435fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f38b193-ddd1-4c45-a17a-9f7b07e435fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebb8335b-9bcc-4be5-97d0-bcaa29a80119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebb8335b-9bcc-4be5-97d0-bcaa29a80119) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6984307e-8f8a-439f-982e-a019b820aa0d', 'volume_name': 'volume-6984307e-8f8a-439f-982e-a019b820aa0d', 'volume_size': 2, 'source_volid': 'c6f976f7-4270-44cd-9d30-ecac8b4c3b9f', 'source_volstatus': 'available'}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ac4e8d-eacd-46de-b06a-962804aa0614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ac4e8d-eacd-46de-b06a-962804aa0614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c220fbf-bd5a-4c32-91da-fb74937c190b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:43 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Volume 6984307e-8f8a-439f-982e-a019b820aa0d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6984307e-8f8a-439f-982e-a019b820aa0d', 'volume_size': 2, 'source_volid': 'c6f976f7-4270-44cd-9d30-ecac8b4c3b9f', 'source_volstatus': 'available'} Jul 10 18:24:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:43 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Cloning volume c6f976f7-4270-44cd-9d30-ecac8b4c3b9f to volume 6984307e-8f8a-439f-982e-a019b820aa0d Jul 10 18:24:43 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Creating offline snapshot 0998ac4e-fb0a-4681-98f9-d1088fd02830 of volume c6f976f7-4270-44cd-9d30-ecac8b4c3b9f {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:24:43 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65dbefe-9afc-4e67-ba85-a321a4c84792]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:24:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:43 devstack sudo[102783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f Jul 10 18:24:43 devstack sudo[102783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:43 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02e53a22-34ae-431b-aea0-4c5a1142842d_r_oskbqrdevstack@QuobyteHD" returned: 1 in 0.727s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02e53a22-34ae-431b-aea0-4c5a1142842d_r_oskbqrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:24:43 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Temporary image 02e53a22-34ae-431b-aea0-4c5a1142842d is fetched for user f4d677218f574723916991e8b7381217. {{(pid=87399) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 18:24:44 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9ed1fe-a805-43e9-a266-45d2b0574c25]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:24:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02e53a22-34ae-431b-aea0-4c5a1142842d_r_oskbqrdevstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:44 devstack sudo[102788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02e53a22-34ae-431b-aea0-4c5a1142842d_r_oskbqrdevstack@QuobyteHD Jul 10 18:24:44 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:44 devstack sudo[102783]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f" returned: 0 in 0.789s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f.0998ac4e-fb0a-4681-98f9-d1088fd02830 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:44 devstack sudo[102793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f.0998ac4e-fb0a-4681-98f9-d1088fd02830 1G Jul 10 18:24:44 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:44 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02e53a22-34ae-431b-aea0-4c5a1142842d_r_oskbqrdevstack@QuobyteHD" returned: 0 in 0.729s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02e53a22-34ae-431b-aea0-4c5a1142842d_r_oskbqrdevstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:44 devstack sudo[102797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02e53a22-34ae-431b-aea0-4c5a1142842d_r_oskbqrdevstack@QuobyteHD Jul 10 18:24:44 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:45 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f.0998ac4e-fb0a-4681-98f9-d1088fd02830 1G" returned: 0 in 0.786s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f.0998ac4e-fb0a-4681-98f9-d1088fd02830 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:45 devstack sudo[102802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f.0998ac4e-fb0a-4681-98f9-d1088fd02830 Jul 10 18:24:45 devstack sudo[102802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:45 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02e53a22-34ae-431b-aea0-4c5a1142842d_r_oskbqrdevstack@QuobyteHD" returned: 1 in 0.730s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02e53a22-34ae-431b-aea0-4c5a1142842d_r_oskbqrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:24:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:45 devstack sudo[102802]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f.0998ac4e-fb0a-4681-98f9-d1088fd02830" returned: 0 in 0.698s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:45 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f.0998ac4e-fb0a-4681-98f9-d1088fd02830 is being set with open permissions: ugo+rw Jul 10 18:24:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f.0998ac4e-fb0a-4681-98f9-d1088fd02830 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:45 devstack sudo[102810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f.0998ac4e-fb0a-4681-98f9-d1088fd02830 Jul 10 18:24:45 devstack sudo[102810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:46 devstack sudo[102810]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f.0998ac4e-fb0a-4681-98f9-d1088fd02830" returned: 0 in 0.629s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:46 devstack sudo[102814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f.info Jul 10 18:24:46 devstack sudo[102814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:47 devstack sudo[102814]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f.info" returned: 0 in 0.641s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:47 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f.info is being set with open permissions: ugo+rw Jul 10 18:24:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:47 devstack sudo[102817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f.info Jul 10 18:24:47 devstack sudo[102817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:47 devstack sudo[102817]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f.info" returned: 0 in 0.637s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:47 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Acquiring lock "cinder-quobyte-6984307e-8f8a-439f-982e-a019b820aa0d" by "_copy_volume_from_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:24:47 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Lock "cinder-quobyte-6984307e-8f8a-439f-982e-a019b820aa0d" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:24:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] snapshot: 0998ac4e-fb0a-4681-98f9-d1088fd02830, volume: 6984307e-8f8a-439f-982e-a019b820aa0d, {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 18:24:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:24:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:24:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:47 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a3fc7c-8c19-4722-bd2b-540c1732d570]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:24:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f.0998ac4e-fb0a-4681-98f9-d1088fd02830 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:47 devstack sudo[102820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f.0998ac4e-fb0a-4681-98f9-d1088fd02830 Jul 10 18:24:47 devstack sudo[102820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:48 devstack sudo[102820]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f.0998ac4e-fb0a-4681-98f9-d1088fd02830" returned: 0 in 0.733s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:48 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:24:48 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] will copy from snapshot at /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 18:24:48 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Creating direct copy from snapshot {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 18:24:48 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb01578-2418-4c6c-a133-e23064055c2d]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:24:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:48 devstack sudo[102825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f Jul 10 18:24:48 devstack sudo[102825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:49 devstack sudo[102825]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f" returned: 0 in 0.780s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:49 devstack cinder-volume[87399]: DEBUG cinder.utils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Path /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6984307e-8f8a-439f-982e-a019b820aa0d not found in is_blk_device check {{(pid=87399) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 18:24:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6984307e-8f8a-439f-982e-a019b820aa0d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:49 devstack sudo[102866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6984307e-8f8a-439f-982e-a019b820aa0d Jul 10 18:24:49 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:53 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6984307e-8f8a-439f-982e-a019b820aa0d" returned: 0 in 4.550s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:53 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[61eebd81-ec3d-4ced-bd7d-a7362beb5868]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:24:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:54 devstack sudo[102880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f Jul 10 18:24:54 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:54 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=70,cinder:UPDATE=85,cinder:DELETE=7,cinder:INSERT=24 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:24:54 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f" returned: 0 in 0.913s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:54 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Image conversion details: src /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f, size 1024.00 MB, duration 4.55 sec, destination /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6984307e-8f8a-439f-982e-a019b820aa0d {{(pid=87399) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 18:24:54 devstack cinder-volume[87399]: INFO cinder.image.image_utils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Converted 1024.00 MB image at 225.01 MB/s Jul 10 18:24:54 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6984307e-8f8a-439f-982e-a019b820aa0d is being set with open permissions: ugo+rw Jul 10 18:24:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6984307e-8f8a-439f-982e-a019b820aa0d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:54 devstack sudo[102885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6984307e-8f8a-439f-982e-a019b820aa0d Jul 10 18:24:54 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:55 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6984307e-8f8a-439f-982e-a019b820aa0d" returned: 0 in 0.647s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Lock "cinder-quobyte-6984307e-8f8a-439f-982e-a019b820aa0d" released by "_copy_volume_from_snapshot" :: held 7.700s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:24:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Acquiring lock "cinder-quobyte-0998ac4e-fb0a-4681-98f9-d1088fd02830" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:24:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Lock "cinder-quobyte-0998ac4e-fb0a-4681-98f9-d1088fd02830" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:24:55 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Deleting offline snapshot 0998ac4e-fb0a-4681-98f9-d1088fd02830 of volume c6f976f7-4270-44cd-9d30-ecac8b4c3b9f {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:24:55 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] snapshot_file for this snap is: volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f.0998ac4e-fb0a-4681-98f9-d1088fd02830 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:24:55 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[3404e9b9-2db2-46ef-acb3-3b605033e272]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:24:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f.0998ac4e-fb0a-4681-98f9-d1088fd02830 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:55 devstack sudo[102890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f.0998ac4e-fb0a-4681-98f9-d1088fd02830 Jul 10 18:24:55 devstack sudo[102890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:56 devstack sudo[102890]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f.0998ac4e-fb0a-4681-98f9-d1088fd02830" returned: 0 in 0.773s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:24:56 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[916121bf-2ac3-45b2-a1e2-6de265ec89bc]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:24:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:56 devstack sudo[102896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f Jul 10 18:24:56 devstack sudo[102896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:56 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=60,cinder:UPDATE=95,cinder:INSERT=22,cinder:DELETE=9 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:24:57 devstack sudo[102896]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f" returned: 0 in 0.749s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f.0998ac4e-fb0a-4681-98f9-d1088fd02830 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:57 devstack sudo[102901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f.0998ac4e-fb0a-4681-98f9-d1088fd02830 Jul 10 18:24:57 devstack sudo[102901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:57 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:24:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:24:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:24:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:57 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:24:57 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:57 devstack sudo[102901]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f.0998ac4e-fb0a-4681-98f9-d1088fd02830" returned: 0 in 0.721s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f.0998ac4e-fb0a-4681-98f9-d1088fd02830 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:57 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f.0998ac4e-fb0a-4681-98f9-d1088fd02830 Jul 10 18:24:57 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:58 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.650s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:58 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:24:58 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager._thread_info {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:24:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread count: 28 {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 18:24:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread info: [<_MainThread(MainThread, started 139757428633728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 18:24:58 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f.0998ac4e-fb0a-4681-98f9-d1088fd02830" returned: 0 in 0.644s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:58 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Lock "cinder-quobyte-0998ac4e-fb0a-4681-98f9-d1088fd02830" released by "_delete_snapshot" :: held 2.967s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:24:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.017s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.992s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e90aa4e-75ea-4d23-a9e1-395880dded22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5ca1f83163245ea9202ecc7a5e92723',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:24:42Z,use_quota=True,user_id='f4d677218f574723916991e8b7381217',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:24:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Creating volume 1e90aa4e-75ea-4d23-a9e1-395880dded22 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:24:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:24:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:24:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:24:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:24:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:24:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:24:58 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:24:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e90aa4e-75ea-4d23-a9e1-395880dded22 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:58 devstack sudo[102912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e90aa4e-75ea-4d23-a9e1-395880dded22 1073741824 Jul 10 18:24:58 devstack sudo[102912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c220fbf-bd5a-4c32-91da-fb74937c190b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6984307e-8f8a-439f-982e-a019b820aa0d', 'volume_size': 2, 'source_volid': 'c6f976f7-4270-44cd-9d30-ecac8b4c3b9f', 'source_volstatus': 'available'}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (233a7e37-226a-4ffe-8681-ed8a20853022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:24:58 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Volume volume-6984307e-8f8a-439f-982e-a019b820aa0d (6984307e-8f8a-439f-982e-a019b820aa0d): created successfully Jul 10 18:24:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (233a7e37-226a-4ffe-8681-ed8a20853022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:24:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Flow 'volume_create_manager' (10b15c9b-a57f-4b75-8a6c-f001410c51fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:24:58 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-96a44ed5-02cf-49e5-b694-81cf0bc0e64a tempest-VolumesCloneTest-229752678 None] Created volume successfully. Jul 10 18:24:59 devstack sudo[102912]: pam_unix(sudo:session): session closed for user root Jul 10 18:24:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e90aa4e-75ea-4d23-a9e1-395880dded22 1073741824" returned: 0 in 0.810s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:24:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e90aa4e-75ea-4d23-a9e1-395880dded22 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:59 devstack sudo[102918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e90aa4e-75ea-4d23-a9e1-395880dded22 Jul 10 18:24:59 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:24:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-9908dfae-7aa1-4123-abd7-346dbde725c2 tempest-VolumesCloneTest-229752678 None] Acquiring lock "cinder-6984307e-8f8a-439f-982e-a019b820aa0d-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:24:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-9908dfae-7aa1-4123-abd7-346dbde725c2 tempest-VolumesCloneTest-229752678 None] Lock "cinder-6984307e-8f8a-439f-982e-a019b820aa0d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:24:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-9908dfae-7aa1-4123-abd7-346dbde725c2 tempest-VolumesCloneTest-229752678 None] Acquiring lock "cinder-quobyte-6984307e-8f8a-439f-982e-a019b820aa0d" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:24:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-9908dfae-7aa1-4123-abd7-346dbde725c2 tempest-VolumesCloneTest-229752678 None] Lock "cinder-quobyte-6984307e-8f8a-439f-982e-a019b820aa0d" acquired by "delete_volume" :: waited 0.015s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:24:59 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e06fe9-038c-4b07-878f-9317ee24ccde]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:24:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9908dfae-7aa1-4123-abd7-346dbde725c2 tempest-VolumesCloneTest-229752678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6984307e-8f8a-439f-982e-a019b820aa0d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:24:59 devstack sudo[102920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6984307e-8f8a-439f-982e-a019b820aa0d Jul 10 18:24:59 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:00 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e90aa4e-75ea-4d23-a9e1-395880dded22" returned: 0 in 0.670s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:25:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:25:00 devstack cinder-volume[87399]: DEBUG cinder.volume.volume_utils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Attempting download of 02e53a22-34ae-431b-aea0-4c5a1142842d ((None, [{'url': 'file:///opt/stack/data/glance/images/02e53a22-34ae-431b-aea0-4c5a1142842d', 'metadata': {}}])) to volume 1e90aa4e-75ea-4d23-a9e1-395880dded22. {{(pid=87399) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 18:25:00 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efe11ff-d50a-40b8-a8d3-0bdc0bc0b478]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:25:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02e53a22-34ae-431b-aea0-4c5a1142842d_bt009kuy {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:00 devstack sudo[102926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02e53a22-34ae-431b-aea0-4c5a1142842d_bt009kuy Jul 10 18:25:00 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:00 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9908dfae-7aa1-4123-abd7-346dbde725c2 tempest-VolumesCloneTest-229752678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6984307e-8f8a-439f-982e-a019b820aa0d" returned: 0 in 0.783s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9908dfae-7aa1-4123-abd7-346dbde725c2 tempest-VolumesCloneTest-229752678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6984307e-8f8a-439f-982e-a019b820aa0d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:00 devstack sudo[102934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6984307e-8f8a-439f-982e-a019b820aa0d Jul 10 18:25:00 devstack sudo[102934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:00 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02e53a22-34ae-431b-aea0-4c5a1142842d_bt009kuy" returned: 0 in 0.754s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02e53a22-34ae-431b-aea0-4c5a1142842d_bt009kuy {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:00 devstack sudo[103015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02e53a22-34ae-431b-aea0-4c5a1142842d_bt009kuy Jul 10 18:25:00 devstack sudo[103015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:01 devstack sudo[102934]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9908dfae-7aa1-4123-abd7-346dbde725c2 tempest-VolumesCloneTest-229752678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6984307e-8f8a-439f-982e-a019b820aa0d" returned: 0 in 0.659s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-9908dfae-7aa1-4123-abd7-346dbde725c2 tempest-VolumesCloneTest-229752678 None] Lock "cinder-quobyte-6984307e-8f8a-439f-982e-a019b820aa0d" released by "delete_volume" :: held 1.491s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:25:01 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-9908dfae-7aa1-4123-abd7-346dbde725c2 tempest-VolumesCloneTest-229752678 None] Created reservations ['38a58f38-c8df-4d4b-8ebe-278bac141493', '1606ccb2-7601-4181-9755-5e9c3e315222', '1f41fce9-3ec1-4395-9bf3-a73c6a6a7e40', 'a2003ca6-e51e-447d-9731-b30a12487e00'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:25:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9908dfae-7aa1-4123-abd7-346dbde725c2 tempest-VolumesCloneTest-229752678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:25:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9908dfae-7aa1-4123-abd7-346dbde725c2 tempest-VolumesCloneTest-229752678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:25:01 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9908dfae-7aa1-4123-abd7-346dbde725c2 tempest-VolumesCloneTest-229752678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:25:01 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9908dfae-7aa1-4123-abd7-346dbde725c2 tempest-VolumesCloneTest-229752678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:25:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9908dfae-7aa1-4123-abd7-346dbde725c2 tempest-VolumesCloneTest-229752678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:25:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9908dfae-7aa1-4123-abd7-346dbde725c2 tempest-VolumesCloneTest-229752678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:01 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:25:01 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:01 devstack sudo[103015]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02e53a22-34ae-431b-aea0-4c5a1142842d_bt009kuy" returned: 1 in 0.795s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02e53a22-34ae-431b-aea0-4c5a1142842d_bt009kuy' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:25:01 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ec2364-e63c-43ea-aba7-8366972bf680]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:25:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02e53a22-34ae-431b-aea0-4c5a1142842d_r_oskbqrdevstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:01 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02e53a22-34ae-431b-aea0-4c5a1142842d_r_oskbqrdevstack@QuobyteHD Jul 10 18:25:01 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5457d5d9-1cc9-498a-8541-2e76fd87585d tempest-VolumesCloneTest-229752678 None] Acquiring lock "cinder-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:25:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5457d5d9-1cc9-498a-8541-2e76fd87585d tempest-VolumesCloneTest-229752678 None] Lock "cinder-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:25:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5457d5d9-1cc9-498a-8541-2e76fd87585d tempest-VolumesCloneTest-229752678 None] Acquiring lock "cinder-quobyte-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:25:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5457d5d9-1cc9-498a-8541-2e76fd87585d tempest-VolumesCloneTest-229752678 None] Lock "cinder-quobyte-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f" acquired by "delete_volume" :: waited 0.015s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:25:01 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad6e84f-1c1f-45b2-8d80-daf8c8d5bf1e]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:25:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5457d5d9-1cc9-498a-8541-2e76fd87585d tempest-VolumesCloneTest-229752678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:02 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9908dfae-7aa1-4123-abd7-346dbde725c2 tempest-VolumesCloneTest-229752678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.707s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:02 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-9908dfae-7aa1-4123-abd7-346dbde725c2 tempest-VolumesCloneTest-229752678 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:25:02 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-9908dfae-7aa1-4123-abd7-346dbde725c2 tempest-VolumesCloneTest-229752678 None] Deleted volume successfully. Jul 10 18:25:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-9908dfae-7aa1-4123-abd7-346dbde725c2 tempest-VolumesCloneTest-229752678 None] Lock "cinder-6984307e-8f8a-439f-982e-a019b820aa0d-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:25:02 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f Jul 10 18:25:02 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:02 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02e53a22-34ae-431b-aea0-4c5a1142842d_r_oskbqrdevstack@QuobyteHD" returned: 0 in 0.779s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02e53a22-34ae-431b-aea0-4c5a1142842d_r_oskbqrdevstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:02 devstack sudo[103286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02e53a22-34ae-431b-aea0-4c5a1142842d_r_oskbqrdevstack@QuobyteHD Jul 10 18:25:02 devstack sudo[103286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:02 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5457d5d9-1cc9-498a-8541-2e76fd87585d tempest-VolumesCloneTest-229752678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f" returned: 0 in 0.783s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5457d5d9-1cc9-498a-8541-2e76fd87585d tempest-VolumesCloneTest-229752678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:02 devstack sudo[103291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f Jul 10 18:25:02 devstack sudo[103291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:03 devstack sudo[103286]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02e53a22-34ae-431b-aea0-4c5a1142842d_r_oskbqrdevstack@QuobyteHD" returned: 1 in 0.746s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02e53a22-34ae-431b-aea0-4c5a1142842d_r_oskbqrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:25:03 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] 02e53a22-34ae-431b-aea0-4c5a1142842d was raw, converting to raw {{(pid=87399) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 18:25:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_02e53a22-34ae-431b-aea0-4c5a1142842d_r_oskbqrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e90aa4e-75ea-4d23-a9e1-395880dded22 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:03 devstack sudo[103296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_02e53a22-34ae-431b-aea0-4c5a1142842d_r_oskbqrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e90aa4e-75ea-4d23-a9e1-395880dded22 Jul 10 18:25:03 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:03 devstack sudo[103291]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5457d5d9-1cc9-498a-8541-2e76fd87585d tempest-VolumesCloneTest-229752678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f" returned: 0 in 0.656s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:03 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5457d5d9-1cc9-498a-8541-2e76fd87585d tempest-VolumesCloneTest-229752678 None] Lock "cinder-quobyte-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f" released by "delete_volume" :: held 1.501s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:25:03 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-5457d5d9-1cc9-498a-8541-2e76fd87585d tempest-VolumesCloneTest-229752678 None] Created reservations ['a5c13307-8c68-475b-88f8-d3f1f13ac4c9', '0c0d12a9-23e0-4186-aaca-f4307092fb06', 'f716b1c3-0ace-407e-91fb-b3d1b8ce26e6', '27797d02-f292-4e0e-a402-1365b1bc8fc3'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:25:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5457d5d9-1cc9-498a-8541-2e76fd87585d tempest-VolumesCloneTest-229752678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:25:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5457d5d9-1cc9-498a-8541-2e76fd87585d tempest-VolumesCloneTest-229752678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:25:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5457d5d9-1cc9-498a-8541-2e76fd87585d tempest-VolumesCloneTest-229752678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:25:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5457d5d9-1cc9-498a-8541-2e76fd87585d tempest-VolumesCloneTest-229752678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:25:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5457d5d9-1cc9-498a-8541-2e76fd87585d tempest-VolumesCloneTest-229752678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:25:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5457d5d9-1cc9-498a-8541-2e76fd87585d tempest-VolumesCloneTest-229752678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:03 devstack sudo[103299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:25:03 devstack sudo[103299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:03 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_02e53a22-34ae-431b-aea0-4c5a1142842d_r_oskbqrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e90aa4e-75ea-4d23-a9e1-395880dded22" returned: 0 in 0.736s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:03 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_02e53a22-34ae-431b-aea0-4c5a1142842d_r_oskbqrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e90aa4e-75ea-4d23-a9e1-395880dded22 {{(pid=87399) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 18:25:03 devstack cinder-volume[87399]: INFO cinder.image.image_utils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 18:25:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e90aa4e-75ea-4d23-a9e1-395880dded22 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:03 devstack sudo[103304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e90aa4e-75ea-4d23-a9e1-395880dded22 1G Jul 10 18:25:03 devstack sudo[103304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:04 devstack sudo[103299]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5457d5d9-1cc9-498a-8541-2e76fd87585d tempest-VolumesCloneTest-229752678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.705s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:04 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-5457d5d9-1cc9-498a-8541-2e76fd87585d tempest-VolumesCloneTest-229752678 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:25:04 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-5457d5d9-1cc9-498a-8541-2e76fd87585d tempest-VolumesCloneTest-229752678 None] Deleted volume successfully. Jul 10 18:25:04 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5457d5d9-1cc9-498a-8541-2e76fd87585d tempest-VolumesCloneTest-229752678 None] Lock "cinder-c6f976f7-4270-44cd-9d30-ecac8b4c3b9f-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:25:04 devstack sudo[103304]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e90aa4e-75ea-4d23-a9e1-395880dded22 1G" returned: 0 in 0.720s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:04 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[777f9a38-488a-4ccf-93f1-49033d06c636]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:25:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e90aa4e-75ea-4d23-a9e1-395880dded22 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:04 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e90aa4e-75ea-4d23-a9e1-395880dded22 Jul 10 18:25:04 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:05 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e90aa4e-75ea-4d23-a9e1-395880dded22" returned: 0 in 0.838s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e90aa4e-75ea-4d23-a9e1-395880dded22 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:05 devstack sudo[103315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e90aa4e-75ea-4d23-a9e1-395880dded22 Jul 10 18:25:05 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:06 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e90aa4e-75ea-4d23-a9e1-395880dded22" returned: 1 in 0.774s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e90aa4e-75ea-4d23-a9e1-395880dded22' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:25:06 devstack cinder-volume[87399]: DEBUG cinder.volume.volume_utils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Downloaded image 02e53a22-34ae-431b-aea0-4c5a1142842d ((None, [{'url': 'file:///opt/stack/data/glance/images/02e53a22-34ae-431b-aea0-4c5a1142842d', 'metadata': {}}])) to volume 1e90aa4e-75ea-4d23-a9e1-395880dded22 successfully. {{(pid=87399) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 18:25:06 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Temporary image 02e53a22-34ae-431b-aea0-4c5a1142842d for user f4d677218f574723916991e8b7381217 is deleted. {{(pid=87399) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 18:25:06 devstack cinder-volume[87399]: DEBUG cinder.volume.volume_utils [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Marking volume 1e90aa4e-75ea-4d23-a9e1-395880dded22 as bootable. {{(pid=87399) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 18:25:06 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Copying metadata from image 02e53a22-34ae-431b-aea0-4c5a1142842d to 1e90aa4e-75ea-4d23-a9e1-395880dded22. {{(pid=87399) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 18:25:06 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Creating volume glance metadata for volume 1e90aa4e-75ea-4d23-a9e1-395880dded22 backed by image 02e53a22-34ae-431b-aea0-4c5a1142842d with: {'image_id': '02e53a22-34ae-431b-aea0-4c5a1142842d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f2be1472d7fc6ed912f7eeeeed03d223', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87399) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 18:25:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51e46a3c-34aa-46ca-9b5d-554561bb3829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e90aa4e-75ea-4d23-a9e1-395880dded22', 'volume_size': 1, 'image_id': '02e53a22-34ae-431b-aea0-4c5a1142842d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02e53a22-34ae-431b-aea0-4c5a1142842d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f2be1472d7fc6ed912f7eeeeed03d223', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f5ca1f83163245ea9202ecc7a5e92723', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b582966232ef1ffde7f4a25893c63c77582834d98b7c473ea46b370bcc92e91395e17d6309eb7db2eabe438ec430199c6f89cdd7543a90445c22c5c4b3b9b463', 'id': '02e53a22-34ae-431b-aea0-4c5a1142842d', 'created_at': datetime.datetime(2026, 7, 10, 16, 24, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 16, 24, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02e53a22-34ae-431b-aea0-4c5a1142842d/file', 'properties': {}}, 'image_service': }' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:25:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9ec403a-6174-4d02-a8e5-d821036c05fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:25:06 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Volume volume-1e90aa4e-75ea-4d23-a9e1-395880dded22 (1e90aa4e-75ea-4d23-a9e1-395880dded22): created successfully Jul 10 18:25:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9ec403a-6174-4d02-a8e5-d821036c05fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:25:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Flow 'volume_create_manager' (4dfd3a08-b85b-409f-a9fb-8157629d4328) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:25:06 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-b74cd465-5e5d-4309-a0f8-88d836618cdf tempest-VolumeImageDependencyTests-2071664110 None] Created volume successfully. Jul 10 18:25:06 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-593c1f96-12c0-4565-a1a8-2f2ac9eeaee1 tempest-VolumeImageDependencyTests-2071664110 None] Acquiring lock "cinder-1e90aa4e-75ea-4d23-a9e1-395880dded22-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:25:06 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-593c1f96-12c0-4565-a1a8-2f2ac9eeaee1 tempest-VolumeImageDependencyTests-2071664110 None] Lock "cinder-1e90aa4e-75ea-4d23-a9e1-395880dded22-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:25:06 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-593c1f96-12c0-4565-a1a8-2f2ac9eeaee1 tempest-VolumeImageDependencyTests-2071664110 None] Acquiring lock "cinder-quobyte-1e90aa4e-75ea-4d23-a9e1-395880dded22" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:25:06 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-593c1f96-12c0-4565-a1a8-2f2ac9eeaee1 tempest-VolumeImageDependencyTests-2071664110 None] Lock "cinder-quobyte-1e90aa4e-75ea-4d23-a9e1-395880dded22" acquired by "delete_volume" :: waited 0.020s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:25:06 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cdf80d-0d6d-4a4a-9556-d3496ac1b8c0]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:25:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-593c1f96-12c0-4565-a1a8-2f2ac9eeaee1 tempest-VolumeImageDependencyTests-2071664110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e90aa4e-75ea-4d23-a9e1-395880dded22 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:06 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:25:06 devstack sudo[103321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e90aa4e-75ea-4d23-a9e1-395880dded22 Jul 10 18:25:06 devstack sudo[103321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] Flow 'volume_create_manager' (25e9d53f-4a40-467f-85cd-3f31cd56820c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:25:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7090cf20-0fe3-4b39-8911-0f25ad83bcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:25:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7090cf20-0fe3-4b39-8911-0f25ad83bcd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1228362869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b14d75d-9f53-4ca9-8a4b-cd73ecd8fe17,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0044381da7204dfa80025c2081c88a0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:25:07Z,use_quota=True,user_id='ff58487a8e61414db1e5a4859f3b90bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:25:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fc6abd2-2049-4f45-bdae-849129d0c597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:25:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fc6abd2-2049-4f45-bdae-849129d0c597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:25:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f0d03a7-87c3-4079-af6b-eeec9974d1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:25:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f0d03a7-87c3-4079-af6b-eeec9974d1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b14d75d-9f53-4ca9-8a4b-cd73ecd8fe17', 'volume_name': 'volume-0b14d75d-9f53-4ca9-8a4b-cd73ecd8fe17', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:25:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1307fa6c-59a1-4f8e-89a3-83e4700618fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:25:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1307fa6c-59a1-4f8e-89a3-83e4700618fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:25:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71677c1d-1439-4edf-862c-4d867c407d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:25:07 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] Volume 0b14d75d-9f53-4ca9-8a4b-cd73ecd8fe17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b14d75d-9f53-4ca9-8a4b-cd73ecd8fe17', 'volume_size': 1} Jul 10 18:25:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:25:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:25:07 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:25:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1228362869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b14d75d-9f53-4ca9-8a4b-cd73ecd8fe17,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0044381da7204dfa80025c2081c88a0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:25:07Z,use_quota=True,user_id='ff58487a8e61414db1e5a4859f3b90bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:25:07 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] Creating volume 0b14d75d-9f53-4ca9-8a4b-cd73ecd8fe17 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:25:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:25:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:25:07 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:25:07 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:25:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:25:07 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:25:07 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:25:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0b14d75d-9f53-4ca9-8a4b-cd73ecd8fe17 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:07 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0b14d75d-9f53-4ca9-8a4b-cd73ecd8fe17 1073741824 Jul 10 18:25:07 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:07 devstack sudo[103321]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-593c1f96-12c0-4565-a1a8-2f2ac9eeaee1 tempest-VolumeImageDependencyTests-2071664110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e90aa4e-75ea-4d23-a9e1-395880dded22" returned: 0 in 0.769s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-593c1f96-12c0-4565-a1a8-2f2ac9eeaee1 tempest-VolumeImageDependencyTests-2071664110 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e90aa4e-75ea-4d23-a9e1-395880dded22 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:07 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e90aa4e-75ea-4d23-a9e1-395880dded22 Jul 10 18:25:07 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:07 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0b14d75d-9f53-4ca9-8a4b-cd73ecd8fe17 1073741824" returned: 0 in 0.822s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0b14d75d-9f53-4ca9-8a4b-cd73ecd8fe17 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:07 devstack sudo[103333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0b14d75d-9f53-4ca9-8a4b-cd73ecd8fe17 Jul 10 18:25:07 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:08 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-593c1f96-12c0-4565-a1a8-2f2ac9eeaee1 tempest-VolumeImageDependencyTests-2071664110 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e90aa4e-75ea-4d23-a9e1-395880dded22" returned: 1 in 0.748s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-593c1f96-12c0-4565-a1a8-2f2ac9eeaee1 tempest-VolumeImageDependencyTests-2071664110 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e90aa4e-75ea-4d23-a9e1-395880dded22' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:25:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-593c1f96-12c0-4565-a1a8-2f2ac9eeaee1 tempest-VolumeImageDependencyTests-2071664110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e90aa4e-75ea-4d23-a9e1-395880dded22 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:08 devstack sudo[103338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e90aa4e-75ea-4d23-a9e1-395880dded22 Jul 10 18:25:08 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:08 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0b14d75d-9f53-4ca9-8a4b-cd73ecd8fe17" returned: 0 in 0.664s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:25:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:25:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71677c1d-1439-4edf-862c-4d867c407d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b14d75d-9f53-4ca9-8a4b-cd73ecd8fe17', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:25:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10bbdf68-094f-4a49-9293-2f00b9880f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:25:08 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] Volume volume-0b14d75d-9f53-4ca9-8a4b-cd73ecd8fe17 (0b14d75d-9f53-4ca9-8a4b-cd73ecd8fe17): created successfully Jul 10 18:25:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10bbdf68-094f-4a49-9293-2f00b9880f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:25:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] Flow 'volume_create_manager' (25e9d53f-4a40-467f-85cd-3f31cd56820c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:25:08 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-a2a0a0a9-5ce9-4a4f-912d-318fdc3f52a4 tempest-VolumesListTestJSON-1563171401 None] Created volume successfully. Jul 10 18:25:09 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-593c1f96-12c0-4565-a1a8-2f2ac9eeaee1 tempest-VolumeImageDependencyTests-2071664110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1e90aa4e-75ea-4d23-a9e1-395880dded22" returned: 0 in 0.704s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-593c1f96-12c0-4565-a1a8-2f2ac9eeaee1 tempest-VolumeImageDependencyTests-2071664110 None] Lock "cinder-quobyte-1e90aa4e-75ea-4d23-a9e1-395880dded22" released by "delete_volume" :: held 2.294s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-593c1f96-12c0-4565-a1a8-2f2ac9eeaee1 tempest-VolumeImageDependencyTests-2071664110 None] Created reservations ['9eb0c511-b0c4-4c60-a0f2-e08bc0263fcf', 'fa00410b-97ea-4d30-b820-269421df1b70', '0b13337d-59a2-40b5-82a6-65080307398a', '3bd73a83-efe8-47d5-8206-4f6b5b2da654'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-593c1f96-12c0-4565-a1a8-2f2ac9eeaee1 tempest-VolumeImageDependencyTests-2071664110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-593c1f96-12c0-4565-a1a8-2f2ac9eeaee1 tempest-VolumeImageDependencyTests-2071664110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-593c1f96-12c0-4565-a1a8-2f2ac9eeaee1 tempest-VolumeImageDependencyTests-2071664110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-593c1f96-12c0-4565-a1a8-2f2ac9eeaee1 tempest-VolumeImageDependencyTests-2071664110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-593c1f96-12c0-4565-a1a8-2f2ac9eeaee1 tempest-VolumeImageDependencyTests-2071664110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-593c1f96-12c0-4565-a1a8-2f2ac9eeaee1 tempest-VolumeImageDependencyTests-2071664110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:09 devstack sudo[103342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:25:09 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] Flow 'volume_create_manager' (8219fc8f-b055-4e47-b5cc-20b41a521a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94da14cc-124a-44fe-8615-a7759ab477bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94da14cc-124a-44fe-8615-a7759ab477bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-393957840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d922fdd4-8395-4312-97b0-d0897439185e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0044381da7204dfa80025c2081c88a0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:25:10Z,use_quota=True,user_id='ff58487a8e61414db1e5a4859f3b90bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed60d01-e78c-4a16-af0e-66e4967f0c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed60d01-e78c-4a16-af0e-66e4967f0c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (397a7d0c-4c1c-4ea6-b25b-72312f8f07d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (397a7d0c-4c1c-4ea6-b25b-72312f8f07d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd922fdd4-8395-4312-97b0-d0897439185e', 'volume_name': 'volume-d922fdd4-8395-4312-97b0-d0897439185e', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (290eeef6-b53f-4598-b607-94eb0bdd8d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (290eeef6-b53f-4598-b607-94eb0bdd8d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47feca9-2ce4-46ca-a7a5-aba165e42b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:25:09 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] Volume d922fdd4-8395-4312-97b0-d0897439185e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d922fdd4-8395-4312-97b0-d0897439185e', 'volume_size': 1} Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-393957840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d922fdd4-8395-4312-97b0-d0897439185e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0044381da7204dfa80025c2081c88a0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:25:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:25:10Z,use_quota=True,user_id='ff58487a8e61414db1e5a4859f3b90bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] Creating volume d922fdd4-8395-4312-97b0-d0897439185e {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:25:09 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d922fdd4-8395-4312-97b0-d0897439185e 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:09 devstack sudo[103344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d922fdd4-8395-4312-97b0-d0897439185e 1073741824 Jul 10 18:25:09 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:09 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-593c1f96-12c0-4565-a1a8-2f2ac9eeaee1 tempest-VolumeImageDependencyTests-2071664110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.689s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-593c1f96-12c0-4565-a1a8-2f2ac9eeaee1 tempest-VolumeImageDependencyTests-2071664110 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:25:09 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-593c1f96-12c0-4565-a1a8-2f2ac9eeaee1 tempest-VolumeImageDependencyTests-2071664110 None] Deleted volume successfully. Jul 10 18:25:09 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-593c1f96-12c0-4565-a1a8-2f2ac9eeaee1 tempest-VolumeImageDependencyTests-2071664110 None] Lock "cinder-1e90aa4e-75ea-4d23-a9e1-395880dded22-delete_volume" released by "delete_volume" :: held 3.197s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:25:10 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d922fdd4-8395-4312-97b0-d0897439185e 1073741824" returned: 0 in 0.873s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d922fdd4-8395-4312-97b0-d0897439185e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:10 devstack sudo[103351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d922fdd4-8395-4312-97b0-d0897439185e Jul 10 18:25:10 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:11 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d922fdd4-8395-4312-97b0-d0897439185e" returned: 0 in 0.660s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:11 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:25:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:25:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47feca9-2ce4-46ca-a7a5-aba165e42b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d922fdd4-8395-4312-97b0-d0897439185e', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:25:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e21155e-0e0d-4c84-9e54-49f7f8aeb2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:25:11 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] Volume volume-d922fdd4-8395-4312-97b0-d0897439185e (d922fdd4-8395-4312-97b0-d0897439185e): created successfully Jul 10 18:25:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e21155e-0e0d-4c84-9e54-49f7f8aeb2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:25:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] Flow 'volume_create_manager' (8219fc8f-b055-4e47-b5cc-20b41a521a92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:25:11 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-8ea3ddca-c0c7-4034-8338-cc2313b39e0d tempest-VolumesListTestJSON-1563171401 None] Created volume successfully. Jul 10 18:25:12 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:25:12 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] Flow 'volume_create_manager' (ce4b6222-399c-40dd-a74f-d2fddb345c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:25:12 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eb3fc82-e969-4a39-b716-f713ccc356a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:25:12 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eb3fc82-e969-4a39-b716-f713ccc356a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-382632734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1c7660-6ea1-42e6-9d38-e1cf103069be,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0044381da7204dfa80025c2081c88a0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:25:12Z,use_quota=True,user_id='ff58487a8e61414db1e5a4859f3b90bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:25:12 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a07b7be-51f7-42cb-b4ff-3be464d6eb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:25:12 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a07b7be-51f7-42cb-b4ff-3be464d6eb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:25:12 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea3ecf1-8c5d-41d4-9991-1ae914143eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:25:12 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea3ecf1-8c5d-41d4-9991-1ae914143eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc1c7660-6ea1-42e6-9d38-e1cf103069be', 'volume_name': 'volume-dc1c7660-6ea1-42e6-9d38-e1cf103069be', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:25:12 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52e4b5cc-7e21-44f3-a934-6ad3b48f2459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:25:12 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52e4b5cc-7e21-44f3-a934-6ad3b48f2459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:25:12 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c526011-736b-4416-b1f6-9cddd491c846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:25:12 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] Volume dc1c7660-6ea1-42e6-9d38-e1cf103069be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc1c7660-6ea1-42e6-9d38-e1cf103069be', 'volume_size': 1} Jul 10 18:25:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:25:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:25:12 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-382632734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1c7660-6ea1-42e6-9d38-e1cf103069be,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0044381da7204dfa80025c2081c88a0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:25:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:25:12Z,use_quota=True,user_id='ff58487a8e61414db1e5a4859f3b90bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:25:12 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] Creating volume dc1c7660-6ea1-42e6-9d38-e1cf103069be {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:25:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:25:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:25:12 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:25:12 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:25:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:25:12 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:25:12 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:25:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-dc1c7660-6ea1-42e6-9d38-e1cf103069be 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:12 devstack sudo[103354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-dc1c7660-6ea1-42e6-9d38-e1cf103069be 1073741824 Jul 10 18:25:12 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:13 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:25:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] Flow 'volume_create_manager' (b9a4c99d-43b6-4103-a9f7-c7bbc829dfcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:25:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6127b8b-6534-4ada-a470-11b260ac2ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:25:13 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-dc1c7660-6ea1-42e6-9d38-e1cf103069be 1073741824" returned: 0 in 0.882s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6127b8b-6534-4ada-a470-11b260ac2ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09138c70-a7ad-48e4-a41f-e995cd633bcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d97abd2264740c2a58833084849b0da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:25:13Z,use_quota=True,user_id='08911c855cee4a79b296face3c69d2e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:25:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90a7c0e-f1d3-410e-81c6-186026b08bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:25:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90a7c0e-f1d3-410e-81c6-186026b08bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:25:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d0638ec-a430-4054-9f85-fd5a15b429cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:25:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d0638ec-a430-4054-9f85-fd5a15b429cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09138c70-a7ad-48e4-a41f-e995cd633bcb', 'volume_name': 'volume-09138c70-a7ad-48e4-a41f-e995cd633bcb', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:25:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b11cdd0-59a4-4628-971c-f3f47d06abe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:25:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b11cdd0-59a4-4628-971c-f3f47d06abe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:25:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d8ce6df-153f-44ea-8ff6-04692694a8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:25:13 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] Volume 09138c70-a7ad-48e4-a41f-e995cd633bcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09138c70-a7ad-48e4-a41f-e995cd633bcb', 'volume_size': 1} Jul 10 18:25:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:25:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-dc1c7660-6ea1-42e6-9d38-e1cf103069be {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:13 devstack sudo[103360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-dc1c7660-6ea1-42e6-9d38-e1cf103069be Jul 10 18:25:13 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:13 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-dc1c7660-6ea1-42e6-9d38-e1cf103069be" returned: 0 in 0.673s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:13 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:25:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:25:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.700s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:25:13 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09138c70-a7ad-48e4-a41f-e995cd633bcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d97abd2264740c2a58833084849b0da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:25:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:25:13Z,use_quota=True,user_id='08911c855cee4a79b296face3c69d2e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:25:13 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] Creating volume 09138c70-a7ad-48e4-a41f-e995cd633bcb {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:25:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:25:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:25:13 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:25:13 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:25:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:25:13 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:25:13 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:25:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09138c70-a7ad-48e4-a41f-e995cd633bcb 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:13 devstack sudo[103363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09138c70-a7ad-48e4-a41f-e995cd633bcb 1073741824 Jul 10 18:25:13 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c526011-736b-4416-b1f6-9cddd491c846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc1c7660-6ea1-42e6-9d38-e1cf103069be', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:25:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac89a32-5176-4704-b76a-055b5bfcc493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:25:13 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] Volume volume-dc1c7660-6ea1-42e6-9d38-e1cf103069be (dc1c7660-6ea1-42e6-9d38-e1cf103069be): created successfully Jul 10 18:25:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac89a32-5176-4704-b76a-055b5bfcc493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:25:13 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] Flow 'volume_create_manager' (ce4b6222-399c-40dd-a74f-d2fddb345c48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:25:13 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-6ecd5c24-c42c-4348-94bb-63a39804b366 tempest-VolumesListTestJSON-1563171401 None] Created volume successfully. Jul 10 18:25:14 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09138c70-a7ad-48e4-a41f-e995cd633bcb 1073741824" returned: 0 in 0.838s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09138c70-a7ad-48e4-a41f-e995cd633bcb {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:14 devstack sudo[103369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09138c70-a7ad-48e4-a41f-e995cd633bcb Jul 10 18:25:14 devstack sudo[103369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:15 devstack sudo[103369]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09138c70-a7ad-48e4-a41f-e995cd633bcb" returned: 0 in 0.646s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:15 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:25:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:25:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d8ce6df-153f-44ea-8ff6-04692694a8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09138c70-a7ad-48e4-a41f-e995cd633bcb', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:25:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc0f9ebd-640a-4308-abf6-9fbe3d68d8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:25:15 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] Volume volume-09138c70-a7ad-48e4-a41f-e995cd633bcb (09138c70-a7ad-48e4-a41f-e995cd633bcb): created successfully Jul 10 18:25:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc0f9ebd-640a-4308-abf6-9fbe3d68d8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:25:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] Flow 'volume_create_manager' (b9a4c99d-43b6-4103-a9f7-c7bbc829dfcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:25:15 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-2e586c2a-537a-4534-ba54-6015b35ad8c2 tempest-CinderUnicodeTest-258925515 None] Created volume successfully. Jul 10 18:25:16 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f1ee29c9-7f83-4bfb-aafe-52c32f9d720d tempest-VolumesListTestJSON-1563171401 None] Acquiring lock "cinder-dc1c7660-6ea1-42e6-9d38-e1cf103069be-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:25:16 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f1ee29c9-7f83-4bfb-aafe-52c32f9d720d tempest-VolumesListTestJSON-1563171401 None] Lock "cinder-dc1c7660-6ea1-42e6-9d38-e1cf103069be-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:25:16 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f1ee29c9-7f83-4bfb-aafe-52c32f9d720d tempest-VolumesListTestJSON-1563171401 None] Acquiring lock "cinder-quobyte-dc1c7660-6ea1-42e6-9d38-e1cf103069be" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:25:16 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f1ee29c9-7f83-4bfb-aafe-52c32f9d720d tempest-VolumesListTestJSON-1563171401 None] Lock "cinder-quobyte-dc1c7660-6ea1-42e6-9d38-e1cf103069be" acquired by "delete_volume" :: waited 0.015s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:25:16 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[8164723f-fe13-4186-b8ca-633b4ae741fa]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:25:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f1ee29c9-7f83-4bfb-aafe-52c32f9d720d tempest-VolumesListTestJSON-1563171401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-dc1c7660-6ea1-42e6-9d38-e1cf103069be {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:16 devstack sudo[103373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-dc1c7660-6ea1-42e6-9d38-e1cf103069be Jul 10 18:25:16 devstack sudo[103373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:16 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:25:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] Flow 'volume_create_manager' (cc0f4bdb-d85c-4126-bdf9-40500990633c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:25:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9f42203-f026-4551-a521-bd799cb67d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:25:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9f42203-f026-4551-a521-bd799cb67d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:25:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-222570864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be18fc6-7a08-4b74-b990-07ff7f100a51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d97abd2264740c2a58833084849b0da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:25:17Z,use_quota=True,user_id='08911c855cee4a79b296face3c69d2e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:25:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cde69680-7024-4149-87cc-851c51e585dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:25:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cde69680-7024-4149-87cc-851c51e585dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:25:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d8c8456-90ec-4a02-9ada-261fb2ee304f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:25:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d8c8456-90ec-4a02-9ada-261fb2ee304f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9be18fc6-7a08-4b74-b990-07ff7f100a51', 'volume_name': 'volume-9be18fc6-7a08-4b74-b990-07ff7f100a51', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:25:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b6d1fc-d0f0-4b31-b868-9123b2788e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:25:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b6d1fc-d0f0-4b31-b868-9123b2788e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:25:17 devstack sudo[103373]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86317cfa-7c5e-4afd-a779-1d366cf84447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:25:17 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] Volume 9be18fc6-7a08-4b74-b990-07ff7f100a51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9be18fc6-7a08-4b74-b990-07ff7f100a51', 'volume_size': 1} Jul 10 18:25:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:25:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:25:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:25:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-222570864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be18fc6-7a08-4b74-b990-07ff7f100a51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d97abd2264740c2a58833084849b0da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:25:17Z,use_quota=True,user_id='08911c855cee4a79b296face3c69d2e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:25:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] Creating volume 9be18fc6-7a08-4b74-b990-07ff7f100a51 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:25:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:25:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:25:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:25:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:25:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:25:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:25:17 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:25:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f1ee29c9-7f83-4bfb-aafe-52c32f9d720d tempest-VolumesListTestJSON-1563171401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-dc1c7660-6ea1-42e6-9d38-e1cf103069be" returned: 0 in 0.805s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f1ee29c9-7f83-4bfb-aafe-52c32f9d720d tempest-VolumesListTestJSON-1563171401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-dc1c7660-6ea1-42e6-9d38-e1cf103069be {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:17 devstack sudo[103378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51 1073741824 Jul 10 18:25:17 devstack sudo[103378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:17 devstack sudo[103379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-dc1c7660-6ea1-42e6-9d38-e1cf103069be Jul 10 18:25:17 devstack sudo[103379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:17 devstack sudo[103379]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f1ee29c9-7f83-4bfb-aafe-52c32f9d720d tempest-VolumesListTestJSON-1563171401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-dc1c7660-6ea1-42e6-9d38-e1cf103069be" returned: 0 in 0.700s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:17 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f1ee29c9-7f83-4bfb-aafe-52c32f9d720d tempest-VolumesListTestJSON-1563171401 None] Lock "cinder-quobyte-dc1c7660-6ea1-42e6-9d38-e1cf103069be" released by "delete_volume" :: held 1.553s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:25:17 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-f1ee29c9-7f83-4bfb-aafe-52c32f9d720d tempest-VolumesListTestJSON-1563171401 None] Created reservations ['97e8c0c8-6a5e-4d4e-91f9-12e56433d603', 'f6747e07-492f-4784-928d-bfd7adff1a63', '7daa3b5b-a6f3-4e58-bb3d-f21c15e43044', 'ff4a2774-2766-4655-acb1-69b760fadfbb'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:25:17 devstack sudo[103378]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51 1073741824" returned: 0 in 0.831s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f1ee29c9-7f83-4bfb-aafe-52c32f9d720d tempest-VolumesListTestJSON-1563171401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:25:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f1ee29c9-7f83-4bfb-aafe-52c32f9d720d tempest-VolumesListTestJSON-1563171401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:25:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f1ee29c9-7f83-4bfb-aafe-52c32f9d720d tempest-VolumesListTestJSON-1563171401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:25:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f1ee29c9-7f83-4bfb-aafe-52c32f9d720d tempest-VolumesListTestJSON-1563171401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:25:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f1ee29c9-7f83-4bfb-aafe-52c32f9d720d tempest-VolumesListTestJSON-1563171401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:25:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f1ee29c9-7f83-4bfb-aafe-52c32f9d720d tempest-VolumesListTestJSON-1563171401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:17 devstack sudo[103387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:25:17 devstack sudo[103387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:17 devstack sudo[103388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51 Jul 10 18:25:17 devstack sudo[103388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:18 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-6de7ee28-d46d-4bc9-95ac-1bb150a251c5 tempest-VolumesListTestJSON-1563171401 None] Acquiring lock "cinder-d922fdd4-8395-4312-97b0-d0897439185e-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:25:18 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-6de7ee28-d46d-4bc9-95ac-1bb150a251c5 tempest-VolumesListTestJSON-1563171401 None] Lock "cinder-d922fdd4-8395-4312-97b0-d0897439185e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:25:18 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-6de7ee28-d46d-4bc9-95ac-1bb150a251c5 tempest-VolumesListTestJSON-1563171401 None] Acquiring lock "cinder-quobyte-d922fdd4-8395-4312-97b0-d0897439185e" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:25:18 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-6de7ee28-d46d-4bc9-95ac-1bb150a251c5 tempest-VolumesListTestJSON-1563171401 None] Lock "cinder-quobyte-d922fdd4-8395-4312-97b0-d0897439185e" acquired by "delete_volume" :: waited 0.018s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:25:18 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47261b0-7f9a-47a1-b648-136b865b7576]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:25:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6de7ee28-d46d-4bc9-95ac-1bb150a251c5 tempest-VolumesListTestJSON-1563171401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d922fdd4-8395-4312-97b0-d0897439185e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:18 devstack sudo[103387]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f1ee29c9-7f83-4bfb-aafe-52c32f9d720d tempest-VolumesListTestJSON-1563171401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.690s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:18 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-f1ee29c9-7f83-4bfb-aafe-52c32f9d720d tempest-VolumesListTestJSON-1563171401 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:25:18 devstack sudo[103388]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:18 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-f1ee29c9-7f83-4bfb-aafe-52c32f9d720d tempest-VolumesListTestJSON-1563171401 None] Deleted volume successfully. Jul 10 18:25:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51" returned: 0 in 0.692s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:18 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:25:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:25:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86317cfa-7c5e-4afd-a779-1d366cf84447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9be18fc6-7a08-4b74-b990-07ff7f100a51', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:25:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9016a91-8a85-4112-ae56-af90e3f0cbec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:25:18 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f1ee29c9-7f83-4bfb-aafe-52c32f9d720d tempest-VolumesListTestJSON-1563171401 None] Lock "cinder-dc1c7660-6ea1-42e6-9d38-e1cf103069be-delete_volume" released by "delete_volume" :: held 2.505s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:25:18 devstack sudo[103393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d922fdd4-8395-4312-97b0-d0897439185e Jul 10 18:25:18 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:18 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] Volume volume-9be18fc6-7a08-4b74-b990-07ff7f100a51 (9be18fc6-7a08-4b74-b990-07ff7f100a51): created successfully Jul 10 18:25:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9016a91-8a85-4112-ae56-af90e3f0cbec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:25:18 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] Flow 'volume_create_manager' (cc0f4bdb-d85c-4126-bdf9-40500990633c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:25:18 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-aeacd92c-925c-4af1-84ea-08312d729df9 tempest-CinderUnicodeTest-258925515 None] Created volume successfully. Jul 10 18:25:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b999a861-3968-455a-9a99-75b52aaf99d6 tempest-CinderUnicodeTest-258925515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:25:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b999a861-3968-455a-9a99-75b52aaf99d6 tempest-CinderUnicodeTest-258925515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:25:19 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-b999a861-3968-455a-9a99-75b52aaf99d6 tempest-CinderUnicodeTest-258925515 None] Creating offline snapshot e3439ede-c3ad-4015-8f74-28c14641a711 of volume 9be18fc6-7a08-4b74-b990-07ff7f100a51 {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:25:19 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b175762-b2a5-4a26-94d2-8373514b53bd]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:25:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b999a861-3968-455a-9a99-75b52aaf99d6 tempest-CinderUnicodeTest-258925515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:19 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6de7ee28-d46d-4bc9-95ac-1bb150a251c5 tempest-VolumesListTestJSON-1563171401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d922fdd4-8395-4312-97b0-d0897439185e" returned: 0 in 0.803s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6de7ee28-d46d-4bc9-95ac-1bb150a251c5 tempest-VolumesListTestJSON-1563171401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d922fdd4-8395-4312-97b0-d0897439185e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:19 devstack sudo[103400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d922fdd4-8395-4312-97b0-d0897439185e Jul 10 18:25:19 devstack sudo[103400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:19 devstack sudo[103399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51 Jul 10 18:25:19 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:19 devstack sudo[103400]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6de7ee28-d46d-4bc9-95ac-1bb150a251c5 tempest-VolumesListTestJSON-1563171401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d922fdd4-8395-4312-97b0-d0897439185e" returned: 0 in 0.666s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:20 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-6de7ee28-d46d-4bc9-95ac-1bb150a251c5 tempest-VolumesListTestJSON-1563171401 None] Lock "cinder-quobyte-d922fdd4-8395-4312-97b0-d0897439185e" released by "delete_volume" :: held 1.525s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:25:20 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b999a861-3968-455a-9a99-75b52aaf99d6 tempest-CinderUnicodeTest-258925515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51" returned: 0 in 0.766s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b999a861-3968-455a-9a99-75b52aaf99d6 tempest-CinderUnicodeTest-258925515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51.e3439ede-c3ad-4015-8f74-28c14641a711 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:20 devstack sudo[103407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51.e3439ede-c3ad-4015-8f74-28c14641a711 1G Jul 10 18:25:20 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:20 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-6de7ee28-d46d-4bc9-95ac-1bb150a251c5 tempest-VolumesListTestJSON-1563171401 None] Created reservations ['0bb82733-e431-4e70-be65-4787d3b55e86', '80489af1-2340-4fe0-bb00-1a85e4a4822f', '1b10440a-04f4-4136-b3cc-28d35f81a65c', '3fbd934b-e3ca-40df-a650-3869d68e073e'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:25:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6de7ee28-d46d-4bc9-95ac-1bb150a251c5 tempest-VolumesListTestJSON-1563171401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:25:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6de7ee28-d46d-4bc9-95ac-1bb150a251c5 tempest-VolumesListTestJSON-1563171401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:25:20 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6de7ee28-d46d-4bc9-95ac-1bb150a251c5 tempest-VolumesListTestJSON-1563171401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:25:20 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6de7ee28-d46d-4bc9-95ac-1bb150a251c5 tempest-VolumesListTestJSON-1563171401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:25:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6de7ee28-d46d-4bc9-95ac-1bb150a251c5 tempest-VolumesListTestJSON-1563171401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:25:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6de7ee28-d46d-4bc9-95ac-1bb150a251c5 tempest-VolumesListTestJSON-1563171401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:20 devstack sudo[103409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:25:20 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:20 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a56201b1-341e-4795-b714-90967413ad67 tempest-VolumesListTestJSON-1563171401 None] Acquiring lock "cinder-0b14d75d-9f53-4ca9-8a4b-cd73ecd8fe17-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:25:20 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a56201b1-341e-4795-b714-90967413ad67 tempest-VolumesListTestJSON-1563171401 None] Lock "cinder-0b14d75d-9f53-4ca9-8a4b-cd73ecd8fe17-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:25:20 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a56201b1-341e-4795-b714-90967413ad67 tempest-VolumesListTestJSON-1563171401 None] Acquiring lock "cinder-quobyte-0b14d75d-9f53-4ca9-8a4b-cd73ecd8fe17" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:25:20 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a56201b1-341e-4795-b714-90967413ad67 tempest-VolumesListTestJSON-1563171401 None] Lock "cinder-quobyte-0b14d75d-9f53-4ca9-8a4b-cd73ecd8fe17" acquired by "delete_volume" :: waited 0.019s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:25:20 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f209844-8ed2-45bc-8088-8dda374e24b2]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:25:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a56201b1-341e-4795-b714-90967413ad67 tempest-VolumesListTestJSON-1563171401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0b14d75d-9f53-4ca9-8a4b-cd73ecd8fe17 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:20 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6de7ee28-d46d-4bc9-95ac-1bb150a251c5 tempest-VolumesListTestJSON-1563171401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.748s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:20 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-6de7ee28-d46d-4bc9-95ac-1bb150a251c5 tempest-VolumesListTestJSON-1563171401 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:25:20 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-6de7ee28-d46d-4bc9-95ac-1bb150a251c5 tempest-VolumesListTestJSON-1563171401 None] Deleted volume successfully. Jul 10 18:25:20 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-6de7ee28-d46d-4bc9-95ac-1bb150a251c5 tempest-VolumesListTestJSON-1563171401 None] Lock "cinder-d922fdd4-8395-4312-97b0-d0897439185e-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:25:20 devstack sudo[103454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0b14d75d-9f53-4ca9-8a4b-cd73ecd8fe17 Jul 10 18:25:20 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:20 devstack sudo[103454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b999a861-3968-455a-9a99-75b52aaf99d6 tempest-CinderUnicodeTest-258925515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51.e3439ede-c3ad-4015-8f74-28c14641a711 1G" returned: 0 in 0.926s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b999a861-3968-455a-9a99-75b52aaf99d6 tempest-CinderUnicodeTest-258925515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9be18fc6-7a08-4b74-b990-07ff7f100a51 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51.e3439ede-c3ad-4015-8f74-28c14641a711 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:21 devstack sudo[103503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9be18fc6-7a08-4b74-b990-07ff7f100a51 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51.e3439ede-c3ad-4015-8f74-28c14641a711 Jul 10 18:25:21 devstack sudo[103503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:21 devstack sudo[103454]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a56201b1-341e-4795-b714-90967413ad67 tempest-VolumesListTestJSON-1563171401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0b14d75d-9f53-4ca9-8a4b-cd73ecd8fe17" returned: 0 in 0.794s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a56201b1-341e-4795-b714-90967413ad67 tempest-VolumesListTestJSON-1563171401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0b14d75d-9f53-4ca9-8a4b-cd73ecd8fe17 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:21 devstack sudo[103511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0b14d75d-9f53-4ca9-8a4b-cd73ecd8fe17 Jul 10 18:25:21 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:21 devstack sudo[103503]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b999a861-3968-455a-9a99-75b52aaf99d6 tempest-CinderUnicodeTest-258925515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9be18fc6-7a08-4b74-b990-07ff7f100a51 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51.e3439ede-c3ad-4015-8f74-28c14641a711" returned: 0 in 0.728s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:21 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-b999a861-3968-455a-9a99-75b52aaf99d6 tempest-CinderUnicodeTest-258925515 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51.e3439ede-c3ad-4015-8f74-28c14641a711 is being set with open permissions: ugo+rw Jul 10 18:25:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b999a861-3968-455a-9a99-75b52aaf99d6 tempest-CinderUnicodeTest-258925515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51.e3439ede-c3ad-4015-8f74-28c14641a711 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:21 devstack sudo[103513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51.e3439ede-c3ad-4015-8f74-28c14641a711 Jul 10 18:25:21 devstack sudo[103513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:22 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a56201b1-341e-4795-b714-90967413ad67 tempest-VolumesListTestJSON-1563171401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0b14d75d-9f53-4ca9-8a4b-cd73ecd8fe17" returned: 0 in 0.680s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:22 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a56201b1-341e-4795-b714-90967413ad67 tempest-VolumesListTestJSON-1563171401 None] Lock "cinder-quobyte-0b14d75d-9f53-4ca9-8a4b-cd73ecd8fe17" released by "delete_volume" :: held 1.535s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:25:22 devstack sudo[103513]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b999a861-3968-455a-9a99-75b52aaf99d6 tempest-CinderUnicodeTest-258925515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51.e3439ede-c3ad-4015-8f74-28c14641a711" returned: 0 in 0.709s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:22 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-a56201b1-341e-4795-b714-90967413ad67 tempest-VolumesListTestJSON-1563171401 None] Created reservations ['3febc869-1dde-4123-8f30-5ac2a678c2ef', '3d01c814-f5bf-4f4d-a55c-28572bac95b8', '797bdaa2-903f-48a9-9a17-f2f04b3ac7a7', '6fb3512d-09f8-4bdc-932f-4d71b5ecc387'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:25:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b999a861-3968-455a-9a99-75b52aaf99d6 tempest-CinderUnicodeTest-258925515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:22 devstack sudo[103517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51.info Jul 10 18:25:22 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a56201b1-341e-4795-b714-90967413ad67 tempest-VolumesListTestJSON-1563171401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:25:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a56201b1-341e-4795-b714-90967413ad67 tempest-VolumesListTestJSON-1563171401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:25:22 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a56201b1-341e-4795-b714-90967413ad67 tempest-VolumesListTestJSON-1563171401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:25:22 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a56201b1-341e-4795-b714-90967413ad67 tempest-VolumesListTestJSON-1563171401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:25:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a56201b1-341e-4795-b714-90967413ad67 tempest-VolumesListTestJSON-1563171401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:25:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a56201b1-341e-4795-b714-90967413ad67 tempest-VolumesListTestJSON-1563171401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:22 devstack sudo[103519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:25:22 devstack sudo[103519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:23 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b999a861-3968-455a-9a99-75b52aaf99d6 tempest-CinderUnicodeTest-258925515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51.info" returned: 0 in 0.685s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:23 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-b999a861-3968-455a-9a99-75b52aaf99d6 tempest-CinderUnicodeTest-258925515 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51.info is being set with open permissions: ugo+rw Jul 10 18:25:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b999a861-3968-455a-9a99-75b52aaf99d6 tempest-CinderUnicodeTest-258925515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:23 devstack sudo[103523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51.info Jul 10 18:25:23 devstack sudo[103523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:23 devstack sudo[103519]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a56201b1-341e-4795-b714-90967413ad67 tempest-VolumesListTestJSON-1563171401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.666s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:23 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-a56201b1-341e-4795-b714-90967413ad67 tempest-VolumesListTestJSON-1563171401 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:25:23 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-a56201b1-341e-4795-b714-90967413ad67 tempest-VolumesListTestJSON-1563171401 None] Deleted volume successfully. Jul 10 18:25:23 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a56201b1-341e-4795-b714-90967413ad67 tempest-VolumesListTestJSON-1563171401 None] Lock "cinder-0b14d75d-9f53-4ca9-8a4b-cd73ecd8fe17-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:25:23 devstack sudo[103523]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b999a861-3968-455a-9a99-75b52aaf99d6 tempest-CinderUnicodeTest-258925515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51.info" returned: 0 in 0.708s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b999a861-3968-455a-9a99-75b52aaf99d6 tempest-CinderUnicodeTest-258925515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.637s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:25:23 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-b999a861-3968-455a-9a99-75b52aaf99d6 tempest-CinderUnicodeTest-258925515 None] Create snapshot completed successfully Jul 10 18:25:24 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b0b275e7-e988-4c20-85f7-c3bb116ede55 tempest-CinderUnicodeTest-258925515 None] Acquiring lock "cinder-e3439ede-c3ad-4015-8f74-28c14641a711-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:25:24 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b0b275e7-e988-4c20-85f7-c3bb116ede55 tempest-CinderUnicodeTest-258925515 None] Lock "cinder-e3439ede-c3ad-4015-8f74-28c14641a711-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:25:24 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b0b275e7-e988-4c20-85f7-c3bb116ede55 tempest-CinderUnicodeTest-258925515 None] Acquiring lock "cinder-quobyte-9be18fc6-7a08-4b74-b990-07ff7f100a51" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:25:24 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b0b275e7-e988-4c20-85f7-c3bb116ede55 tempest-CinderUnicodeTest-258925515 None] Lock "cinder-quobyte-9be18fc6-7a08-4b74-b990-07ff7f100a51" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:25:24 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b0b275e7-e988-4c20-85f7-c3bb116ede55 tempest-CinderUnicodeTest-258925515 None] Acquiring lock "cinder-quobyte-e3439ede-c3ad-4015-8f74-28c14641a711" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:25:24 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b0b275e7-e988-4c20-85f7-c3bb116ede55 tempest-CinderUnicodeTest-258925515 None] Lock "cinder-quobyte-e3439ede-c3ad-4015-8f74-28c14641a711" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:25:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-b0b275e7-e988-4c20-85f7-c3bb116ede55 tempest-CinderUnicodeTest-258925515 None] Deleting offline snapshot e3439ede-c3ad-4015-8f74-28c14641a711 of volume 9be18fc6-7a08-4b74-b990-07ff7f100a51 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:25:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-b0b275e7-e988-4c20-85f7-c3bb116ede55 tempest-CinderUnicodeTest-258925515 None] snapshot_file for this snap is: volume-9be18fc6-7a08-4b74-b990-07ff7f100a51.e3439ede-c3ad-4015-8f74-28c14641a711 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:25:24 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd8abf5-055b-4df0-93f4-4723c450f257]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:25:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b0b275e7-e988-4c20-85f7-c3bb116ede55 tempest-CinderUnicodeTest-258925515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51.e3439ede-c3ad-4015-8f74-28c14641a711 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:24 devstack sudo[103526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51.e3439ede-c3ad-4015-8f74-28c14641a711 Jul 10 18:25:24 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:25 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b0b275e7-e988-4c20-85f7-c3bb116ede55 tempest-CinderUnicodeTest-258925515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51.e3439ede-c3ad-4015-8f74-28c14641a711" returned: 0 in 0.767s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:25 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-b0b275e7-e988-4c20-85f7-c3bb116ede55 tempest-CinderUnicodeTest-258925515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9be18fc6-7a08-4b74-b990-07ff7f100a51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:25:25 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f0ce12-8fc3-43d1-85ae-06518fb1489b]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:25:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b0b275e7-e988-4c20-85f7-c3bb116ede55 tempest-CinderUnicodeTest-258925515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:25 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51 Jul 10 18:25:25 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:26 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b0b275e7-e988-4c20-85f7-c3bb116ede55 tempest-CinderUnicodeTest-258925515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51" returned: 0 in 0.822s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b0b275e7-e988-4c20-85f7-c3bb116ede55 tempest-CinderUnicodeTest-258925515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51.e3439ede-c3ad-4015-8f74-28c14641a711 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:26 devstack sudo[103537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51.e3439ede-c3ad-4015-8f74-28c14641a711 Jul 10 18:25:26 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:27 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b0b275e7-e988-4c20-85f7-c3bb116ede55 tempest-CinderUnicodeTest-258925515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51.e3439ede-c3ad-4015-8f74-28c14641a711" returned: 0 in 0.787s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b0b275e7-e988-4c20-85f7-c3bb116ede55 tempest-CinderUnicodeTest-258925515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51.e3439ede-c3ad-4015-8f74-28c14641a711 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:27 devstack sudo[103542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51.e3439ede-c3ad-4015-8f74-28c14641a711 Jul 10 18:25:27 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:27 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b0b275e7-e988-4c20-85f7-c3bb116ede55 tempest-CinderUnicodeTest-258925515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51.e3439ede-c3ad-4015-8f74-28c14641a711" returned: 0 in 0.683s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:27 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b0b275e7-e988-4c20-85f7-c3bb116ede55 tempest-CinderUnicodeTest-258925515 None] Lock "cinder-quobyte-e3439ede-c3ad-4015-8f74-28c14641a711" released by "_delete_snapshot" :: held 3.205s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:25:27 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b0b275e7-e988-4c20-85f7-c3bb116ede55 tempest-CinderUnicodeTest-258925515 None] Lock "cinder-quobyte-9be18fc6-7a08-4b74-b990-07ff7f100a51" released by "delete_snapshot" :: held 3.232s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:25:27 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-b0b275e7-e988-4c20-85f7-c3bb116ede55 tempest-CinderUnicodeTest-258925515 None] Created reservations ['0e2d39d9-9b70-43e9-9f68-48860912c412', 'bbaea2c7-370e-4e1b-b306-9ba343242885', '906b53d7-a68e-4904-9df4-02618457dbef', '89bd6156-bd8e-4dcc-9ccc-7f29db187324'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:25:27 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-b0b275e7-e988-4c20-85f7-c3bb116ede55 tempest-CinderUnicodeTest-258925515 None] Delete snapshot completed successfully. Jul 10 18:25:27 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b0b275e7-e988-4c20-85f7-c3bb116ede55 tempest-CinderUnicodeTest-258925515 None] Lock "cinder-e3439ede-c3ad-4015-8f74-28c14641a711-delete_snapshot" released by "delete_snapshot" :: held 3.368s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:25:28 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-886498ed-0077-4ed6-9a7a-b463f02e01fa tempest-CinderUnicodeTest-258925515 None] Acquiring lock "cinder-9be18fc6-7a08-4b74-b990-07ff7f100a51-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:25:28 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-886498ed-0077-4ed6-9a7a-b463f02e01fa tempest-CinderUnicodeTest-258925515 None] Lock "cinder-9be18fc6-7a08-4b74-b990-07ff7f100a51-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:25:28 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-886498ed-0077-4ed6-9a7a-b463f02e01fa tempest-CinderUnicodeTest-258925515 None] Acquiring lock "cinder-quobyte-9be18fc6-7a08-4b74-b990-07ff7f100a51" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:25:28 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-886498ed-0077-4ed6-9a7a-b463f02e01fa tempest-CinderUnicodeTest-258925515 None] Lock "cinder-quobyte-9be18fc6-7a08-4b74-b990-07ff7f100a51" acquired by "delete_volume" :: waited 0.018s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:25:28 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51035a6-c2f5-41b5-8305-6b46ca38d5b6]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:25:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-886498ed-0077-4ed6-9a7a-b463f02e01fa tempest-CinderUnicodeTest-258925515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:28 devstack sudo[103545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51 Jul 10 18:25:28 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:29 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-886498ed-0077-4ed6-9a7a-b463f02e01fa tempest-CinderUnicodeTest-258925515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51" returned: 0 in 0.777s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-886498ed-0077-4ed6-9a7a-b463f02e01fa tempest-CinderUnicodeTest-258925515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:29 devstack sudo[103550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51 Jul 10 18:25:29 devstack sudo[103550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:30 devstack sudo[103550]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-886498ed-0077-4ed6-9a7a-b463f02e01fa tempest-CinderUnicodeTest-258925515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9be18fc6-7a08-4b74-b990-07ff7f100a51" returned: 0 in 0.759s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:30 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-886498ed-0077-4ed6-9a7a-b463f02e01fa tempest-CinderUnicodeTest-258925515 None] Lock "cinder-quobyte-9be18fc6-7a08-4b74-b990-07ff7f100a51" released by "delete_volume" :: held 1.613s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:25:30 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-886498ed-0077-4ed6-9a7a-b463f02e01fa tempest-CinderUnicodeTest-258925515 None] Created reservations ['1c9f03ad-71f2-452b-9fe7-1aa385cb6a10', 'f48657d9-f77e-4d28-ba7a-62c95d797e5a', '6e726e97-d558-4c2a-a2fa-cc2c6bf046ea', 'c88267d0-5ce8-460f-b7fa-c93ddfe3ba06'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:25:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-886498ed-0077-4ed6-9a7a-b463f02e01fa tempest-CinderUnicodeTest-258925515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:25:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-886498ed-0077-4ed6-9a7a-b463f02e01fa tempest-CinderUnicodeTest-258925515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:25:30 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-886498ed-0077-4ed6-9a7a-b463f02e01fa tempest-CinderUnicodeTest-258925515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:25:30 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-886498ed-0077-4ed6-9a7a-b463f02e01fa tempest-CinderUnicodeTest-258925515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:25:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-886498ed-0077-4ed6-9a7a-b463f02e01fa tempest-CinderUnicodeTest-258925515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:25:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-886498ed-0077-4ed6-9a7a-b463f02e01fa tempest-CinderUnicodeTest-258925515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:30 devstack sudo[103553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:25:30 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:31 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5748f79a-206f-47ce-8ef9-578e0852ac45 tempest-CinderUnicodeTest-258925515 None] Acquiring lock "cinder-09138c70-a7ad-48e4-a41f-e995cd633bcb-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:25:31 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5748f79a-206f-47ce-8ef9-578e0852ac45 tempest-CinderUnicodeTest-258925515 None] Lock "cinder-09138c70-a7ad-48e4-a41f-e995cd633bcb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:25:31 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5748f79a-206f-47ce-8ef9-578e0852ac45 tempest-CinderUnicodeTest-258925515 None] Acquiring lock "cinder-quobyte-09138c70-a7ad-48e4-a41f-e995cd633bcb" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:25:31 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5748f79a-206f-47ce-8ef9-578e0852ac45 tempest-CinderUnicodeTest-258925515 None] Lock "cinder-quobyte-09138c70-a7ad-48e4-a41f-e995cd633bcb" acquired by "delete_volume" :: waited 0.021s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:25:31 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b41ab6b-5605-4588-a0c0-a46bcf300da3]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:25:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5748f79a-206f-47ce-8ef9-578e0852ac45 tempest-CinderUnicodeTest-258925515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09138c70-a7ad-48e4-a41f-e995cd633bcb {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:31 devstack sudo[103555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09138c70-a7ad-48e4-a41f-e995cd633bcb Jul 10 18:25:31 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:31 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-886498ed-0077-4ed6-9a7a-b463f02e01fa tempest-CinderUnicodeTest-258925515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.707s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:31 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-886498ed-0077-4ed6-9a7a-b463f02e01fa tempest-CinderUnicodeTest-258925515 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:25:31 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-886498ed-0077-4ed6-9a7a-b463f02e01fa tempest-CinderUnicodeTest-258925515 None] Deleted volume successfully. Jul 10 18:25:31 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-886498ed-0077-4ed6-9a7a-b463f02e01fa tempest-CinderUnicodeTest-258925515 None] Lock "cinder-9be18fc6-7a08-4b74-b990-07ff7f100a51-delete_volume" released by "delete_volume" :: held 2.567s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:25:32 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5748f79a-206f-47ce-8ef9-578e0852ac45 tempest-CinderUnicodeTest-258925515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09138c70-a7ad-48e4-a41f-e995cd633bcb" returned: 0 in 0.882s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5748f79a-206f-47ce-8ef9-578e0852ac45 tempest-CinderUnicodeTest-258925515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09138c70-a7ad-48e4-a41f-e995cd633bcb {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:32 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09138c70-a7ad-48e4-a41f-e995cd633bcb Jul 10 18:25:32 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:32 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5748f79a-206f-47ce-8ef9-578e0852ac45 tempest-CinderUnicodeTest-258925515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-09138c70-a7ad-48e4-a41f-e995cd633bcb" returned: 0 in 0.764s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:32 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5748f79a-206f-47ce-8ef9-578e0852ac45 tempest-CinderUnicodeTest-258925515 None] Lock "cinder-quobyte-09138c70-a7ad-48e4-a41f-e995cd633bcb" released by "delete_volume" :: held 1.692s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:25:32 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-5748f79a-206f-47ce-8ef9-578e0852ac45 tempest-CinderUnicodeTest-258925515 None] Created reservations ['fd3801bd-605e-48d9-ac59-5eb62bca1df9', '831c0fd7-4ba2-41cf-b01d-ffa7c1d63177', '54924e02-286c-41c4-9664-4e62c18500fa', '821bd155-ad88-4530-bc64-5f820a6cb6c1'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:25:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5748f79a-206f-47ce-8ef9-578e0852ac45 tempest-CinderUnicodeTest-258925515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:25:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5748f79a-206f-47ce-8ef9-578e0852ac45 tempest-CinderUnicodeTest-258925515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:25:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5748f79a-206f-47ce-8ef9-578e0852ac45 tempest-CinderUnicodeTest-258925515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:25:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5748f79a-206f-47ce-8ef9-578e0852ac45 tempest-CinderUnicodeTest-258925515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:25:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5748f79a-206f-47ce-8ef9-578e0852ac45 tempest-CinderUnicodeTest-258925515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:25:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5748f79a-206f-47ce-8ef9-578e0852ac45 tempest-CinderUnicodeTest-258925515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:32 devstack sudo[103564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:25:32 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:33 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5748f79a-206f-47ce-8ef9-578e0852ac45 tempest-CinderUnicodeTest-258925515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.727s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:33 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-5748f79a-206f-47ce-8ef9-578e0852ac45 tempest-CinderUnicodeTest-258925515 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:25:33 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-5748f79a-206f-47ce-8ef9-578e0852ac45 tempest-CinderUnicodeTest-258925515 None] Deleted volume successfully. Jul 10 18:25:33 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5748f79a-206f-47ce-8ef9-578e0852ac45 tempest-CinderUnicodeTest-258925515 None] Lock "cinder-09138c70-a7ad-48e4-a41f-e995cd633bcb-delete_volume" released by "delete_volume" :: held 2.655s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:25:42 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:UPDATE=87,cinder:SELECT=70,cinder:DELETE=4,cinder:INSERT=32 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:25:43 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:UPDATE=101,cinder:INSERT=20,cinder:SELECT=62,cinder:DELETE=12 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:25:57 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:25:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:25:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:25:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:25:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:25:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:25:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:25:57 devstack sudo[103659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:25:57 devstack sudo[103659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:25:58 devstack sudo[103659]: pam_unix(sudo:session): session closed for user root Jul 10 18:25:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.777s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:25:58 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:25:58 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager._thread_info {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:25:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread count: 28 {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 18:25:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread info: [<_MainThread(MainThread, started 139757428633728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 18:26:03 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:26:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] Flow 'volume_create_manager' (56321018-2b2e-442d-9e62-3d2e8372e5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:26:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f6ce65a-570f-44de-acbc-5caa5017b76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:26:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f6ce65a-570f-44de-acbc-5caa5017b76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1997140975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2f2fc4f-38ae-4c18-bc10-71c95acb8fed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9347ac5a2c145e1962ad53cb25c238e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:26:03Z,use_quota=True,user_id='8577048ace3047cfbf0917b2dac72401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:26:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f18785f-086f-4293-8dd3-d4fd70ef9c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:26:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f18785f-086f-4293-8dd3-d4fd70ef9c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:26:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65ce80f6-bc70-447e-9a61-ddfb0b6774f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:26:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65ce80f6-bc70-447e-9a61-ddfb0b6774f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2f2fc4f-38ae-4c18-bc10-71c95acb8fed', 'volume_name': 'volume-f2f2fc4f-38ae-4c18-bc10-71c95acb8fed', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:26:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (363e12cd-dbe9-4c6e-95af-97ea73beef9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:26:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (363e12cd-dbe9-4c6e-95af-97ea73beef9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:26:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13df07cd-e8a5-452e-b5c2-5e6eb428ced8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:26:03 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] Volume f2f2fc4f-38ae-4c18-bc10-71c95acb8fed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2f2fc4f-38ae-4c18-bc10-71c95acb8fed', 'volume_size': 1} Jul 10 18:26:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:26:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:26:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1997140975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2f2fc4f-38ae-4c18-bc10-71c95acb8fed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9347ac5a2c145e1962ad53cb25c238e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:26:03Z,use_quota=True,user_id='8577048ace3047cfbf0917b2dac72401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:26:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] Creating volume f2f2fc4f-38ae-4c18-bc10-71c95acb8fed {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:26:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:26:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:26:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:26:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:26:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:26:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:26:03 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:26:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f2f2fc4f-38ae-4c18-bc10-71c95acb8fed 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:26:03 devstack sudo[103723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f2f2fc4f-38ae-4c18-bc10-71c95acb8fed 1073741824 Jul 10 18:26:03 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:26:04 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root Jul 10 18:26:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f2f2fc4f-38ae-4c18-bc10-71c95acb8fed 1073741824" returned: 0 in 0.805s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:26:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f2f2fc4f-38ae-4c18-bc10-71c95acb8fed {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:26:04 devstack sudo[103728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f2f2fc4f-38ae-4c18-bc10-71c95acb8fed Jul 10 18:26:04 devstack sudo[103728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:26:05 devstack sudo[103728]: pam_unix(sudo:session): session closed for user root Jul 10 18:26:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f2f2fc4f-38ae-4c18-bc10-71c95acb8fed" returned: 0 in 0.647s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:26:05 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:26:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:26:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13df07cd-e8a5-452e-b5c2-5e6eb428ced8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2f2fc4f-38ae-4c18-bc10-71c95acb8fed', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:26:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633c0a3e-37f9-4153-b95e-e7c6cf452c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:26:05 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] Volume volume-f2f2fc4f-38ae-4c18-bc10-71c95acb8fed (f2f2fc4f-38ae-4c18-bc10-71c95acb8fed): created successfully Jul 10 18:26:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (633c0a3e-37f9-4153-b95e-e7c6cf452c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:26:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] Flow 'volume_create_manager' (56321018-2b2e-442d-9e62-3d2e8372e5a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:26:05 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-c3a3cced-f639-493e-9a6a-3a295dbdfef6 tempest-TestMinimumBasicScenario-1816643677 None] Created volume successfully. Jul 10 18:26:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-cedde124-9f0a-440d-9c8b-f5d0383e6c60 req-f8c56fef-3a0b-4597-9582-0287445e0e4a tempest-TestMinimumBasicScenario-1816643677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:26:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-cedde124-9f0a-440d-9c8b-f5d0383e6c60 req-f8c56fef-3a0b-4597-9582-0287445e0e4a tempest-TestMinimumBasicScenario-1816643677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:26:08 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5540c5-c8ee-4a7d-8cd5-f004066e68ee]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:26:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-cedde124-9f0a-440d-9c8b-f5d0383e6c60 req-f8c56fef-3a0b-4597-9582-0287445e0e4a tempest-TestMinimumBasicScenario-1816643677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f2f2fc4f-38ae-4c18-bc10-71c95acb8fed {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:26:08 devstack sudo[103743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f2f2fc4f-38ae-4c18-bc10-71c95acb8fed Jul 10 18:26:08 devstack sudo[103743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:26:09 devstack sudo[103743]: pam_unix(sudo:session): session closed for user root Jul 10 18:26:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-cedde124-9f0a-440d-9c8b-f5d0383e6c60 req-f8c56fef-3a0b-4597-9582-0287445e0e4a tempest-TestMinimumBasicScenario-1816643677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f2f2fc4f-38ae-4c18-bc10-71c95acb8fed" returned: 0 in 0.789s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:26:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-cedde124-9f0a-440d-9c8b-f5d0383e6c60 req-f8c56fef-3a0b-4597-9582-0287445e0e4a tempest-TestMinimumBasicScenario-1816643677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.812s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:26:09 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-cedde124-9f0a-440d-9c8b-f5d0383e6c60 req-f8c56fef-3a0b-4597-9582-0287445e0e4a tempest-TestMinimumBasicScenario-1816643677 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd', 'name': 'volume-f2f2fc4f-38ae-4c18-bc10-71c95acb8fed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '14103d63-7ce3-471c-8566-f6c40df3adad', 'enforce_multipath': True} {{(pid=87399) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 18:26:09 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-cedde124-9f0a-440d-9c8b-f5d0383e6c60 req-f8c56fef-3a0b-4597-9582-0287445e0e4a tempest-TestMinimumBasicScenario-1816643677 None] attachment_update completed successfully. Jul 10 18:26:19 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:UPDATE=4,cinder:SELECT=6,cinder:DELETE=1 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:26:19 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:26:53 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-89522e77-0ee6-4c04-aae3-038b792443e2 req-ec1d33f1-3f13-4d1e-a81f-06be038f8b42 tempest-TestMinimumBasicScenario-1816643677 None] Terminate volume connection completed successfully. Jul 10 18:26:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-89522e77-0ee6-4c04-aae3-038b792443e2 req-ec1d33f1-3f13-4d1e-a81f-06be038f8b42 tempest-TestMinimumBasicScenario-1816643677 None] Deleting attachment 14103d63-7ce3-471c-8566-f6c40df3adad. {{(pid=87399) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 18:26:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0b600d06-2e1f-4afd-86d6-53a4679cf887 tempest-TestMinimumBasicScenario-1816643677 None] Acquiring lock "cinder-f2f2fc4f-38ae-4c18-bc10-71c95acb8fed-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:26:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0b600d06-2e1f-4afd-86d6-53a4679cf887 tempest-TestMinimumBasicScenario-1816643677 None] Lock "cinder-f2f2fc4f-38ae-4c18-bc10-71c95acb8fed-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:26:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0b600d06-2e1f-4afd-86d6-53a4679cf887 tempest-TestMinimumBasicScenario-1816643677 None] Acquiring lock "cinder-quobyte-f2f2fc4f-38ae-4c18-bc10-71c95acb8fed" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:26:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0b600d06-2e1f-4afd-86d6-53a4679cf887 tempest-TestMinimumBasicScenario-1816643677 None] Lock "cinder-quobyte-f2f2fc4f-38ae-4c18-bc10-71c95acb8fed" acquired by "delete_volume" :: waited 0.018s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:26:55 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdbbdbf-a26f-4fa3-9d2b-feb06c7e41a6]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:26:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0b600d06-2e1f-4afd-86d6-53a4679cf887 tempest-TestMinimumBasicScenario-1816643677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f2f2fc4f-38ae-4c18-bc10-71c95acb8fed {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:26:55 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f2f2fc4f-38ae-4c18-bc10-71c95acb8fed Jul 10 18:26:55 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:26:56 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Jul 10 18:26:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0b600d06-2e1f-4afd-86d6-53a4679cf887 tempest-TestMinimumBasicScenario-1816643677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f2f2fc4f-38ae-4c18-bc10-71c95acb8fed" returned: 0 in 0.742s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:26:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0b600d06-2e1f-4afd-86d6-53a4679cf887 tempest-TestMinimumBasicScenario-1816643677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f2f2fc4f-38ae-4c18-bc10-71c95acb8fed {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:26:56 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f2f2fc4f-38ae-4c18-bc10-71c95acb8fed Jul 10 18:26:56 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:26:56 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Jul 10 18:26:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0b600d06-2e1f-4afd-86d6-53a4679cf887 tempest-TestMinimumBasicScenario-1816643677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f2f2fc4f-38ae-4c18-bc10-71c95acb8fed" returned: 0 in 0.646s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:26:56 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0b600d06-2e1f-4afd-86d6-53a4679cf887 tempest-TestMinimumBasicScenario-1816643677 None] Lock "cinder-quobyte-f2f2fc4f-38ae-4c18-bc10-71c95acb8fed" released by "delete_volume" :: held 1.432s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:26:56 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-0b600d06-2e1f-4afd-86d6-53a4679cf887 tempest-TestMinimumBasicScenario-1816643677 None] Created reservations ['dc35d98a-700c-4ca1-9454-fa507ea6f42d', '3437fa35-7b72-4567-836f-e62bfc863a49', '0d8f526e-7d1e-4f5b-9fa4-86cb225ad0ba', 'd0f7c2bd-8140-4c41-9e46-cb11d172e2c2'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:26:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0b600d06-2e1f-4afd-86d6-53a4679cf887 tempest-TestMinimumBasicScenario-1816643677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:26:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0b600d06-2e1f-4afd-86d6-53a4679cf887 tempest-TestMinimumBasicScenario-1816643677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:26:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0b600d06-2e1f-4afd-86d6-53a4679cf887 tempest-TestMinimumBasicScenario-1816643677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:26:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0b600d06-2e1f-4afd-86d6-53a4679cf887 tempest-TestMinimumBasicScenario-1816643677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:26:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0b600d06-2e1f-4afd-86d6-53a4679cf887 tempest-TestMinimumBasicScenario-1816643677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:26:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0b600d06-2e1f-4afd-86d6-53a4679cf887 tempest-TestMinimumBasicScenario-1816643677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:26:56 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:26:56 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:26:57 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Jul 10 18:26:57 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:26:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:26:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:26:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:26:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:26:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:26:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:26:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0b600d06-2e1f-4afd-86d6-53a4679cf887 tempest-TestMinimumBasicScenario-1816643677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.689s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:26:57 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-0b600d06-2e1f-4afd-86d6-53a4679cf887 tempest-TestMinimumBasicScenario-1816643677 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:26:57 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-0b600d06-2e1f-4afd-86d6-53a4679cf887 tempest-TestMinimumBasicScenario-1816643677 None] Deleted volume successfully. Jul 10 18:26:57 devstack sudo[104293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:26:57 devstack sudo[104293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:26:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-0b600d06-2e1f-4afd-86d6-53a4679cf887 tempest-TestMinimumBasicScenario-1816643677 None] Lock "cinder-f2f2fc4f-38ae-4c18-bc10-71c95acb8fed-delete_volume" released by "delete_volume" :: held 2.322s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:26:58 devstack sudo[104293]: pam_unix(sudo:session): session closed for user root Jul 10 18:26:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.683s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:26:58 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:26:58 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager._thread_info {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:26:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread count: 28 {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 18:26:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread info: [<_MainThread(MainThread, started 139757428633728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 18:27:06 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=7,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:27:07 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=5,cinder:INSERT=3,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:27:30 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:27:31 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:27:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] Flow 'volume_create_manager' (35eb4f32-f736-46ac-8ca0-7bee50827a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:27:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df5e42be-b048-4c68-86e6-30f3a37f17bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:27:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df5e42be-b048-4c68-86e6-30f3a37f17bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-884607915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4ad5413-040f-403a-ab2f-bcce01b4046e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c92fc5fce0af4f1fa3ccc7bd372f8258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:27:32Z,use_quota=True,user_id='6027f8f1828d442d976f91e28f0d27aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:27:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a21a10cc-442e-418c-89dd-e8722feda317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:27:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a21a10cc-442e-418c-89dd-e8722feda317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:27:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b72ed38-b4b3-4e90-86c3-c112cb88f2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:27:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b72ed38-b4b3-4e90-86c3-c112cb88f2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4ad5413-040f-403a-ab2f-bcce01b4046e', 'volume_name': 'volume-b4ad5413-040f-403a-ab2f-bcce01b4046e', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:27:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af73ccc-43b4-44fd-85cb-8b67aad07ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:27:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af73ccc-43b4-44fd-85cb-8b67aad07ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:27:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2548d4e-d341-48f8-af94-f7c4d291cbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:27:31 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] Volume b4ad5413-040f-403a-ab2f-bcce01b4046e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4ad5413-040f-403a-ab2f-bcce01b4046e', 'volume_size': 1} Jul 10 18:27:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:27:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:27:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-884607915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4ad5413-040f-403a-ab2f-bcce01b4046e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c92fc5fce0af4f1fa3ccc7bd372f8258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:27:32Z,use_quota=True,user_id='6027f8f1828d442d976f91e28f0d27aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:27:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] Creating volume b4ad5413-040f-403a-ab2f-bcce01b4046e {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:27:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:27:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:27:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:27:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:27:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:27:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:27:32 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:27:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:27:32 devstack sudo[104335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e 1073741824 Jul 10 18:27:32 devstack sudo[104335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:27:32 devstack sudo[104335]: pam_unix(sudo:session): session closed for user root Jul 10 18:27:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e 1073741824" returned: 0 in 0.870s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:27:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:27:32 devstack sudo[104345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e Jul 10 18:27:32 devstack sudo[104345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:27:33 devstack sudo[104345]: pam_unix(sudo:session): session closed for user root Jul 10 18:27:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e" returned: 0 in 0.661s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:27:33 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:27:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:27:33 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2548d4e-d341-48f8-af94-f7c4d291cbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4ad5413-040f-403a-ab2f-bcce01b4046e', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:27:33 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f9cd2cd-a01e-4753-b959-37d155df9cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:27:33 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] Volume volume-b4ad5413-040f-403a-ab2f-bcce01b4046e (b4ad5413-040f-403a-ab2f-bcce01b4046e): created successfully Jul 10 18:27:33 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f9cd2cd-a01e-4753-b959-37d155df9cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:27:33 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] Flow 'volume_create_manager' (35eb4f32-f736-46ac-8ca0-7bee50827a0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:27:33 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-dd862754-017a-4058-a570-6129aa5e1b76 tempest-TestStampPattern-8896191 None] Created volume successfully. Jul 10 18:27:43 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:27:43 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:27:57 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:27:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:27:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:27:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:27:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:27:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:27:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:27:57 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:27:57 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:27:58 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Jul 10 18:27:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.635s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:27:58 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:27:58 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager._thread_info {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:27:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread count: 28 {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 18:27:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread info: [<_MainThread(MainThread, started 139757428633728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 18:28:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-d95f0ffe-ac91-4091-8e90-7db91d45c463 req-b48c795d-eac4-4788-9047-f976f4c0f321 tempest-TestStampPattern-8896191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:28:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-d95f0ffe-ac91-4091-8e90-7db91d45c463 req-b48c795d-eac4-4788-9047-f976f4c0f321 tempest-TestStampPattern-8896191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:28:11 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2b1440-d30c-493f-9f34-2b529033c6ab]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:28:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-d95f0ffe-ac91-4091-8e90-7db91d45c463 req-b48c795d-eac4-4788-9047-f976f4c0f321 tempest-TestStampPattern-8896191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:28:11 devstack sudo[104521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e Jul 10 18:28:11 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:28:12 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root Jul 10 18:28:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-d95f0ffe-ac91-4091-8e90-7db91d45c463 req-b48c795d-eac4-4788-9047-f976f4c0f321 tempest-TestStampPattern-8896191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e" returned: 0 in 0.751s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:28:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-d95f0ffe-ac91-4091-8e90-7db91d45c463 req-b48c795d-eac4-4788-9047-f976f4c0f321 tempest-TestStampPattern-8896191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.776s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:28:12 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-d95f0ffe-ac91-4091-8e90-7db91d45c463 req-b48c795d-eac4-4788-9047-f976f4c0f321 tempest-TestStampPattern-8896191 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd', 'name': 'volume-b4ad5413-040f-403a-ab2f-bcce01b4046e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '07ecf65c-6a86-4be7-a74a-b1634771b063', 'enforce_multipath': True} {{(pid=87399) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 18:28:12 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-d95f0ffe-ac91-4091-8e90-7db91d45c463 req-b48c795d-eac4-4788-9047-f976f4c0f321 tempest-TestStampPattern-8896191 None] attachment_update completed successfully. Jul 10 18:28:20 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-a8470c81-119e-4954-94ee-189083d8a186 req-a3beed92-de19-46ac-83cc-a1550e047456 tempest-TestStampPattern-8896191 None] Terminate volume connection completed successfully. Jul 10 18:28:20 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-a8470c81-119e-4954-94ee-189083d8a186 req-a3beed92-de19-46ac-83cc-a1550e047456 tempest-TestStampPattern-8896191 None] Deleting attachment 07ecf65c-6a86-4be7-a74a-b1634771b063. {{(pid=87399) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 18:28:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-37406c7e-5c38-4c98-942d-b2657151b03d tempest-TestStampPattern-8896191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:28:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-37406c7e-5c38-4c98-942d-b2657151b03d tempest-TestStampPattern-8896191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:28:22 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-37406c7e-5c38-4c98-942d-b2657151b03d tempest-TestStampPattern-8896191 None] Creating offline snapshot 55f710c9-405f-43ba-ae68-4cc02a191dfd of volume b4ad5413-040f-403a-ab2f-bcce01b4046e {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:28:22 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae9c97f-9bfa-40d6-9d84-f3a7b9fc87d4]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:28:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-37406c7e-5c38-4c98-942d-b2657151b03d tempest-TestStampPattern-8896191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:28:22 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e Jul 10 18:28:22 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:28:23 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Jul 10 18:28:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-37406c7e-5c38-4c98-942d-b2657151b03d tempest-TestStampPattern-8896191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e" returned: 0 in 0.771s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:28:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-37406c7e-5c38-4c98-942d-b2657151b03d tempest-TestStampPattern-8896191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e.55f710c9-405f-43ba-ae68-4cc02a191dfd 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:28:23 devstack sudo[104964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e.55f710c9-405f-43ba-ae68-4cc02a191dfd 1G Jul 10 18:28:23 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:28:23 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root Jul 10 18:28:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-37406c7e-5c38-4c98-942d-b2657151b03d tempest-TestStampPattern-8896191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e.55f710c9-405f-43ba-ae68-4cc02a191dfd 1G" returned: 0 in 0.806s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:28:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-37406c7e-5c38-4c98-942d-b2657151b03d tempest-TestStampPattern-8896191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4ad5413-040f-403a-ab2f-bcce01b4046e -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e.55f710c9-405f-43ba-ae68-4cc02a191dfd {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:28:23 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4ad5413-040f-403a-ab2f-bcce01b4046e -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e.55f710c9-405f-43ba-ae68-4cc02a191dfd Jul 10 18:28:23 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:28:24 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Jul 10 18:28:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-37406c7e-5c38-4c98-942d-b2657151b03d tempest-TestStampPattern-8896191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4ad5413-040f-403a-ab2f-bcce01b4046e -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e.55f710c9-405f-43ba-ae68-4cc02a191dfd" returned: 0 in 0.700s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:28:24 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-37406c7e-5c38-4c98-942d-b2657151b03d tempest-TestStampPattern-8896191 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e.55f710c9-405f-43ba-ae68-4cc02a191dfd is being set with open permissions: ugo+rw Jul 10 18:28:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-37406c7e-5c38-4c98-942d-b2657151b03d tempest-TestStampPattern-8896191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e.55f710c9-405f-43ba-ae68-4cc02a191dfd {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:28:24 devstack sudo[104974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e.55f710c9-405f-43ba-ae68-4cc02a191dfd Jul 10 18:28:24 devstack sudo[104974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:28:25 devstack sudo[104974]: pam_unix(sudo:session): session closed for user root Jul 10 18:28:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-37406c7e-5c38-4c98-942d-b2657151b03d tempest-TestStampPattern-8896191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e.55f710c9-405f-43ba-ae68-4cc02a191dfd" returned: 0 in 0.638s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:28:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-37406c7e-5c38-4c98-942d-b2657151b03d tempest-TestStampPattern-8896191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:28:25 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e.info Jul 10 18:28:25 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:28:25 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Jul 10 18:28:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-37406c7e-5c38-4c98-942d-b2657151b03d tempest-TestStampPattern-8896191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e.info" returned: 0 in 0.654s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:28:25 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-37406c7e-5c38-4c98-942d-b2657151b03d tempest-TestStampPattern-8896191 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e.info is being set with open permissions: ugo+rw Jul 10 18:28:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-37406c7e-5c38-4c98-942d-b2657151b03d tempest-TestStampPattern-8896191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:28:25 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e.info Jul 10 18:28:25 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:28:26 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Jul 10 18:28:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-37406c7e-5c38-4c98-942d-b2657151b03d tempest-TestStampPattern-8896191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e.info" returned: 0 in 0.647s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:28:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-37406c7e-5c38-4c98-942d-b2657151b03d tempest-TestStampPattern-8896191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.297s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:28:26 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-37406c7e-5c38-4c98-942d-b2657151b03d tempest-TestStampPattern-8896191 None] Create snapshot completed successfully Jul 10 18:28:36 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=10,cinder:UPDATE=2 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:28:36 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=10,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:28:37 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:28:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Flow 'volume_create_manager' (9b370fbc-51b2-4b11-8ce7-2c979c72d738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:28:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c43f2001-0c61-46af-94a2-045ec3871108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:28:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c43f2001-0c61-46af-94a2-045ec3871108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:28:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1690052255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a28ca7f-f2a2-4122-9718-ed29de041885,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c92fc5fce0af4f1fa3ccc7bd372f8258',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=55f710c9-405f-43ba-ae68-4cc02a191dfd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:28:37Z,use_quota=True,user_id='6027f8f1828d442d976f91e28f0d27aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:28:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6619118-324e-4f27-968f-054c70589a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:28:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6619118-324e-4f27-968f-054c70589a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:28:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (017b7986-77cd-4669-8b8a-042edd546b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:28:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (017b7986-77cd-4669-8b8a-042edd546b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7a28ca7f-f2a2-4122-9718-ed29de041885', 'volume_name': 'volume-7a28ca7f-f2a2-4122-9718-ed29de041885', 'volume_size': 1, 'snapshot_id': '55f710c9-405f-43ba-ae68-4cc02a191dfd'}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:28:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4f380e2-9a41-4ad5-a644-260e09829e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:28:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4f380e2-9a41-4ad5-a644-260e09829e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:28:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d51fa45f-5e9a-4ac2-b1bf-264ac65d9720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:28:37 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Volume 7a28ca7f-f2a2-4122-9718-ed29de041885: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7a28ca7f-f2a2-4122-9718-ed29de041885', 'volume_size': 1, 'snapshot_id': '55f710c9-405f-43ba-ae68-4cc02a191dfd'} Jul 10 18:28:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:28:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:28:37 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Acquiring lock "cinder-quobyte-55f710c9-405f-43ba-ae68-4cc02a191dfd-7a28ca7f-f2a2-4122-9718-ed29de041885" by "_create_volume_from_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:28:37 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Lock "cinder-quobyte-55f710c9-405f-43ba-ae68-4cc02a191dfd-7a28ca7f-f2a2-4122-9718-ed29de041885" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:28:37 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Creating volume 7a28ca7f-f2a2-4122-9718-ed29de041885 from snapshot 55f710c9-405f-43ba-ae68-4cc02a191dfd {{(pid=87399) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 18:28:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:28:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:28:37 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:28:37 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:28:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:28:37 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:28:37 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Acquiring lock "cinder-quobyte-7a28ca7f-f2a2-4122-9718-ed29de041885" by "_copy_volume_from_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:28:37 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Lock "cinder-quobyte-7a28ca7f-f2a2-4122-9718-ed29de041885" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:28:37 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] snapshot: 55f710c9-405f-43ba-ae68-4cc02a191dfd, volume: 7a28ca7f-f2a2-4122-9718-ed29de041885, {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 18:28:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:28:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:28:37 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:28:37 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:28:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:28:37 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e230151-7d79-44c6-9113-f4a8e25cd1f1]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:28:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e.55f710c9-405f-43ba-ae68-4cc02a191dfd {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:28:37 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e.55f710c9-405f-43ba-ae68-4cc02a191dfd Jul 10 18:28:37 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:28:38 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Jul 10 18:28:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e.55f710c9-405f-43ba-ae68-4cc02a191dfd" returned: 0 in 0.795s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:28:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4ad5413-040f-403a-ab2f-bcce01b4046e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:28:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] will copy from snapshot at /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 18:28:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Creating direct copy from snapshot {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 18:28:38 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[a438463e-dc48-4903-82ce-d4a432187b9a]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:28:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:28:38 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e Jul 10 18:28:38 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:28:38 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Jul 10 18:28:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e" returned: 0 in 0.784s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:28:38 devstack cinder-volume[87399]: DEBUG cinder.utils [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Path /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7a28ca7f-f2a2-4122-9718-ed29de041885 not found in is_blk_device check {{(pid=87399) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 18:28:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7a28ca7f-f2a2-4122-9718-ed29de041885 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:28:38 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7a28ca7f-f2a2-4122-9718-ed29de041885 Jul 10 18:28:38 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:28:44 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Jul 10 18:28:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7a28ca7f-f2a2-4122-9718-ed29de041885" returned: 0 in 5.205s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:28:44 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b6d17c-bf0c-4b10-a152-fdfa2543ad1e]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:28:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:28:44 devstack sudo[105051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e Jul 10 18:28:44 devstack sudo[105051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:28:45 devstack sudo[105051]: pam_unix(sudo:session): session closed for user root Jul 10 18:28:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e" returned: 0 in 1.045s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:28:45 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Image conversion details: src /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e, size 1024.00 MB, duration 5.21 sec, destination /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7a28ca7f-f2a2-4122-9718-ed29de041885 {{(pid=87399) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 18:28:45 devstack cinder-volume[87399]: INFO cinder.image.image_utils [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Converted 1024.00 MB image at 196.68 MB/s Jul 10 18:28:45 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7a28ca7f-f2a2-4122-9718-ed29de041885 is being set with open permissions: ugo+rw Jul 10 18:28:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7a28ca7f-f2a2-4122-9718-ed29de041885 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:28:45 devstack sudo[105056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7a28ca7f-f2a2-4122-9718-ed29de041885 Jul 10 18:28:45 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:28:45 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root Jul 10 18:28:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7a28ca7f-f2a2-4122-9718-ed29de041885" returned: 0 in 0.719s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:28:45 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Lock "cinder-quobyte-7a28ca7f-f2a2-4122-9718-ed29de041885" released by "_copy_volume_from_snapshot" :: held 8.654s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:28:45 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Lock "cinder-quobyte-55f710c9-405f-43ba-ae68-4cc02a191dfd-7a28ca7f-f2a2-4122-9718-ed29de041885" released by "_create_volume_from_snapshot" :: held 8.687s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:28:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.702s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:28:45 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d51fa45f-5e9a-4ac2-b1bf-264ac65d9720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a28ca7f-f2a2-4122-9718-ed29de041885', 'volume_size': 1, 'snapshot_id': '55f710c9-405f-43ba-ae68-4cc02a191dfd'}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:28:45 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (214ae1ad-f12f-4756-a4c5-120e7a88cf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:28:45 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Volume volume-7a28ca7f-f2a2-4122-9718-ed29de041885 (7a28ca7f-f2a2-4122-9718-ed29de041885): created successfully Jul 10 18:28:45 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (214ae1ad-f12f-4756-a4c5-120e7a88cf55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:28:45 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Flow 'volume_create_manager' (9b370fbc-51b2-4b11-8ce7-2c979c72d738) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:28:45 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-ce4d8177-7d4f-494a-a285-24816eca807c tempest-TestStampPattern-8896191 None] Created volume successfully. Jul 10 18:28:55 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:28:55 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2,cinder:DELETE=1 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:28:57 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:28:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:28:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:28:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:28:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:28:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:28:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:28:57 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:28:57 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:28:58 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Jul 10 18:28:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.649s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:28:58 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:28:58 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager._thread_info {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:28:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread count: 28 {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 18:28:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread info: [<_MainThread(MainThread, started 139757428633728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 18:29:30 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=1 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:29:30 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:UPDATE=1 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:29:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-784c9f6e-6041-404c-a6d2-35122bbfd7ab req-265674d2-6cc5-4b45-980d-a6d3e6e9867e tempest-TestStampPattern-8896191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:29:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-784c9f6e-6041-404c-a6d2-35122bbfd7ab req-265674d2-6cc5-4b45-980d-a6d3e6e9867e tempest-TestStampPattern-8896191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:29:34 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[303d951d-1882-42e4-8e7c-258bbaa6f6c8]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:29:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-784c9f6e-6041-404c-a6d2-35122bbfd7ab req-265674d2-6cc5-4b45-980d-a6d3e6e9867e tempest-TestStampPattern-8896191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7a28ca7f-f2a2-4122-9718-ed29de041885 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:29:34 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7a28ca7f-f2a2-4122-9718-ed29de041885 Jul 10 18:29:34 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:29:35 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Jul 10 18:29:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [req-784c9f6e-6041-404c-a6d2-35122bbfd7ab req-265674d2-6cc5-4b45-980d-a6d3e6e9867e tempest-TestStampPattern-8896191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7a28ca7f-f2a2-4122-9718-ed29de041885" returned: 0 in 0.769s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:29:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [req-784c9f6e-6041-404c-a6d2-35122bbfd7ab req-265674d2-6cc5-4b45-980d-a6d3e6e9867e tempest-TestStampPattern-8896191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.787s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:29:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-784c9f6e-6041-404c-a6d2-35122bbfd7ab req-265674d2-6cc5-4b45-980d-a6d3e6e9867e tempest-TestStampPattern-8896191 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd', 'name': 'volume-7a28ca7f-f2a2-4122-9718-ed29de041885', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2f324d54-2b2e-4e16-97c4-de227b6b1a15', 'enforce_multipath': True} {{(pid=87399) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 18:29:35 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-784c9f6e-6041-404c-a6d2-35122bbfd7ab req-265674d2-6cc5-4b45-980d-a6d3e6e9867e tempest-TestStampPattern-8896191 None] attachment_update completed successfully. Jul 10 18:29:41 devstack cinder-volume[87399]: INFO cinder.volume.manager [req-ecbb422a-acf3-4201-a794-499a600d1a42 req-cd234b3f-da32-4ace-b6db-55fa648cafcd tempest-TestStampPattern-8896191 None] Terminate volume connection completed successfully. Jul 10 18:29:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [req-ecbb422a-acf3-4201-a794-499a600d1a42 req-cd234b3f-da32-4ace-b6db-55fa648cafcd tempest-TestStampPattern-8896191 None] Deleting attachment 2f324d54-2b2e-4e16-97c4-de227b6b1a15. {{(pid=87399) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 18:29:51 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-73ef1bf5-bc9e-4026-a39e-c7e53f5c3ef6 tempest-TestStampPattern-8896191 None] Acquiring lock "cinder-7a28ca7f-f2a2-4122-9718-ed29de041885-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:29:51 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-73ef1bf5-bc9e-4026-a39e-c7e53f5c3ef6 tempest-TestStampPattern-8896191 None] Lock "cinder-7a28ca7f-f2a2-4122-9718-ed29de041885-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:29:51 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-73ef1bf5-bc9e-4026-a39e-c7e53f5c3ef6 tempest-TestStampPattern-8896191 None] Acquiring lock "cinder-quobyte-7a28ca7f-f2a2-4122-9718-ed29de041885" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:29:51 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-73ef1bf5-bc9e-4026-a39e-c7e53f5c3ef6 tempest-TestStampPattern-8896191 None] Lock "cinder-quobyte-7a28ca7f-f2a2-4122-9718-ed29de041885" acquired by "delete_volume" :: waited 0.014s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:29:51 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b70a16a-4ac2-4dd7-b468-d77bc4410416]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:29:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-73ef1bf5-bc9e-4026-a39e-c7e53f5c3ef6 tempest-TestStampPattern-8896191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7a28ca7f-f2a2-4122-9718-ed29de041885 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:29:51 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7a28ca7f-f2a2-4122-9718-ed29de041885 Jul 10 18:29:51 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:29:52 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Jul 10 18:29:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-73ef1bf5-bc9e-4026-a39e-c7e53f5c3ef6 tempest-TestStampPattern-8896191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7a28ca7f-f2a2-4122-9718-ed29de041885" returned: 0 in 0.740s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:29:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-73ef1bf5-bc9e-4026-a39e-c7e53f5c3ef6 tempest-TestStampPattern-8896191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7a28ca7f-f2a2-4122-9718-ed29de041885 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:29:52 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7a28ca7f-f2a2-4122-9718-ed29de041885 Jul 10 18:29:52 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:29:52 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Jul 10 18:29:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-73ef1bf5-bc9e-4026-a39e-c7e53f5c3ef6 tempest-TestStampPattern-8896191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7a28ca7f-f2a2-4122-9718-ed29de041885" returned: 0 in 0.626s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:29:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-73ef1bf5-bc9e-4026-a39e-c7e53f5c3ef6 tempest-TestStampPattern-8896191 None] Lock "cinder-quobyte-7a28ca7f-f2a2-4122-9718-ed29de041885" released by "delete_volume" :: held 1.404s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:29:52 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-73ef1bf5-bc9e-4026-a39e-c7e53f5c3ef6 tempest-TestStampPattern-8896191 None] Created reservations ['563a8ded-9c4e-4820-ad2c-81cde7529860', '69800260-9823-4deb-964d-48ff962894df', 'fa68a8f2-9790-4e10-980e-011b4d5ea162', 'd24ee824-0f82-462e-9d07-b4a2c1c412db'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:29:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-73ef1bf5-bc9e-4026-a39e-c7e53f5c3ef6 tempest-TestStampPattern-8896191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:29:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-73ef1bf5-bc9e-4026-a39e-c7e53f5c3ef6 tempest-TestStampPattern-8896191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:29:53 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-73ef1bf5-bc9e-4026-a39e-c7e53f5c3ef6 tempest-TestStampPattern-8896191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:29:53 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-73ef1bf5-bc9e-4026-a39e-c7e53f5c3ef6 tempest-TestStampPattern-8896191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:29:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-73ef1bf5-bc9e-4026-a39e-c7e53f5c3ef6 tempest-TestStampPattern-8896191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:29:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-73ef1bf5-bc9e-4026-a39e-c7e53f5c3ef6 tempest-TestStampPattern-8896191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:29:53 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:29:53 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:29:53 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Jul 10 18:29:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-73ef1bf5-bc9e-4026-a39e-c7e53f5c3ef6 tempest-TestStampPattern-8896191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.640s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:29:53 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-73ef1bf5-bc9e-4026-a39e-c7e53f5c3ef6 tempest-TestStampPattern-8896191 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:29:53 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-73ef1bf5-bc9e-4026-a39e-c7e53f5c3ef6 tempest-TestStampPattern-8896191 None] Deleted volume successfully. Jul 10 18:29:53 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-73ef1bf5-bc9e-4026-a39e-c7e53f5c3ef6 tempest-TestStampPattern-8896191 None] Lock "cinder-7a28ca7f-f2a2-4122-9718-ed29de041885-delete_volume" released by "delete_volume" :: held 2.229s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:29:53 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-84f4cd2a-f5c1-4c5d-852c-2e18eb3979e1 tempest-TestStampPattern-8896191 None] Acquiring lock "cinder-55f710c9-405f-43ba-ae68-4cc02a191dfd-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:29:53 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-84f4cd2a-f5c1-4c5d-852c-2e18eb3979e1 tempest-TestStampPattern-8896191 None] Lock "cinder-55f710c9-405f-43ba-ae68-4cc02a191dfd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:29:53 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-84f4cd2a-f5c1-4c5d-852c-2e18eb3979e1 tempest-TestStampPattern-8896191 None] Acquiring lock "cinder-quobyte-b4ad5413-040f-403a-ab2f-bcce01b4046e" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:29:53 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-84f4cd2a-f5c1-4c5d-852c-2e18eb3979e1 tempest-TestStampPattern-8896191 None] Lock "cinder-quobyte-b4ad5413-040f-403a-ab2f-bcce01b4046e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:29:53 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-84f4cd2a-f5c1-4c5d-852c-2e18eb3979e1 tempest-TestStampPattern-8896191 None] Acquiring lock "cinder-quobyte-55f710c9-405f-43ba-ae68-4cc02a191dfd" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:29:53 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-84f4cd2a-f5c1-4c5d-852c-2e18eb3979e1 tempest-TestStampPattern-8896191 None] Lock "cinder-quobyte-55f710c9-405f-43ba-ae68-4cc02a191dfd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:29:53 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-84f4cd2a-f5c1-4c5d-852c-2e18eb3979e1 tempest-TestStampPattern-8896191 None] Deleting offline snapshot 55f710c9-405f-43ba-ae68-4cc02a191dfd of volume b4ad5413-040f-403a-ab2f-bcce01b4046e {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:29:54 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-84f4cd2a-f5c1-4c5d-852c-2e18eb3979e1 tempest-TestStampPattern-8896191 None] snapshot_file for this snap is: volume-b4ad5413-040f-403a-ab2f-bcce01b4046e.55f710c9-405f-43ba-ae68-4cc02a191dfd {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:29:54 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a97e4cc-0969-48bf-98da-be0c685b3e3e]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:29:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-84f4cd2a-f5c1-4c5d-852c-2e18eb3979e1 tempest-TestStampPattern-8896191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e.55f710c9-405f-43ba-ae68-4cc02a191dfd {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:29:54 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e.55f710c9-405f-43ba-ae68-4cc02a191dfd Jul 10 18:29:54 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:29:54 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Jul 10 18:29:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-84f4cd2a-f5c1-4c5d-852c-2e18eb3979e1 tempest-TestStampPattern-8896191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e.55f710c9-405f-43ba-ae68-4cc02a191dfd" returned: 0 in 0.736s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:29:54 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-84f4cd2a-f5c1-4c5d-852c-2e18eb3979e1 tempest-TestStampPattern-8896191 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4ad5413-040f-403a-ab2f-bcce01b4046e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:29:54 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50082a1-c970-4810-aa74-cb4f9f3adb9f]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:29:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-84f4cd2a-f5c1-4c5d-852c-2e18eb3979e1 tempest-TestStampPattern-8896191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:29:54 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e Jul 10 18:29:54 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:29:55 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Jul 10 18:29:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-84f4cd2a-f5c1-4c5d-852c-2e18eb3979e1 tempest-TestStampPattern-8896191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e" returned: 0 in 0.752s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:29:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-84f4cd2a-f5c1-4c5d-852c-2e18eb3979e1 tempest-TestStampPattern-8896191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e.55f710c9-405f-43ba-ae68-4cc02a191dfd {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:29:55 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e.55f710c9-405f-43ba-ae68-4cc02a191dfd Jul 10 18:29:55 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:29:56 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Jul 10 18:29:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-84f4cd2a-f5c1-4c5d-852c-2e18eb3979e1 tempest-TestStampPattern-8896191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e.55f710c9-405f-43ba-ae68-4cc02a191dfd" returned: 0 in 0.724s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:29:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-84f4cd2a-f5c1-4c5d-852c-2e18eb3979e1 tempest-TestStampPattern-8896191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e.55f710c9-405f-43ba-ae68-4cc02a191dfd {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:29:56 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e.55f710c9-405f-43ba-ae68-4cc02a191dfd Jul 10 18:29:56 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:29:56 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Jul 10 18:29:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-84f4cd2a-f5c1-4c5d-852c-2e18eb3979e1 tempest-TestStampPattern-8896191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e.55f710c9-405f-43ba-ae68-4cc02a191dfd" returned: 0 in 0.633s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:29:56 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-84f4cd2a-f5c1-4c5d-852c-2e18eb3979e1 tempest-TestStampPattern-8896191 None] Lock "cinder-quobyte-55f710c9-405f-43ba-ae68-4cc02a191dfd" released by "_delete_snapshot" :: held 2.942s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:29:56 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-84f4cd2a-f5c1-4c5d-852c-2e18eb3979e1 tempest-TestStampPattern-8896191 None] Lock "cinder-quobyte-b4ad5413-040f-403a-ab2f-bcce01b4046e" released by "delete_snapshot" :: held 2.965s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:29:56 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-84f4cd2a-f5c1-4c5d-852c-2e18eb3979e1 tempest-TestStampPattern-8896191 None] Created reservations ['985cb34f-59a3-4366-83d5-085faffbb6c4', '75bce8c6-8082-4d51-8869-3f12169e4924', 'f214b693-2b24-445f-af99-03cf763549fc', '24173e31-7165-4786-8c45-f982bf9f8d06'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:29:57 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-84f4cd2a-f5c1-4c5d-852c-2e18eb3979e1 tempest-TestStampPattern-8896191 None] Delete snapshot completed successfully. Jul 10 18:29:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-84f4cd2a-f5c1-4c5d-852c-2e18eb3979e1 tempest-TestStampPattern-8896191 None] Lock "cinder-55f710c9-405f-43ba-ae68-4cc02a191dfd-delete_snapshot" released by "delete_snapshot" :: held 3.146s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:29:57 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:29:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:29:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:29:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:29:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:29:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:29:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:29:57 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:29:57 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:29:58 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Jul 10 18:29:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.700s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:29:58 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:29:58 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager._thread_info {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:29:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread count: 28 {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 18:29:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread info: [<_MainThread(MainThread, started 139757428633728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 18:30:05 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c0d747ff-5fdd-45f8-8be1-dcce26062335 tempest-TestStampPattern-8896191 None] Acquiring lock "cinder-b4ad5413-040f-403a-ab2f-bcce01b4046e-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:30:05 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c0d747ff-5fdd-45f8-8be1-dcce26062335 tempest-TestStampPattern-8896191 None] Lock "cinder-b4ad5413-040f-403a-ab2f-bcce01b4046e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:30:05 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c0d747ff-5fdd-45f8-8be1-dcce26062335 tempest-TestStampPattern-8896191 None] Acquiring lock "cinder-quobyte-b4ad5413-040f-403a-ab2f-bcce01b4046e" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:30:05 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c0d747ff-5fdd-45f8-8be1-dcce26062335 tempest-TestStampPattern-8896191 None] Lock "cinder-quobyte-b4ad5413-040f-403a-ab2f-bcce01b4046e" acquired by "delete_volume" :: waited 0.014s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:30:05 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f7dd16-9663-4d56-bb5b-169c1b91f8e3]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:30:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c0d747ff-5fdd-45f8-8be1-dcce26062335 tempest-TestStampPattern-8896191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:05 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e Jul 10 18:30:05 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:06 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c0d747ff-5fdd-45f8-8be1-dcce26062335 tempest-TestStampPattern-8896191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e" returned: 0 in 0.731s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c0d747ff-5fdd-45f8-8be1-dcce26062335 tempest-TestStampPattern-8896191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:06 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e Jul 10 18:30:06 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:06 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c0d747ff-5fdd-45f8-8be1-dcce26062335 tempest-TestStampPattern-8896191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b4ad5413-040f-403a-ab2f-bcce01b4046e" returned: 0 in 0.629s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:06 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c0d747ff-5fdd-45f8-8be1-dcce26062335 tempest-TestStampPattern-8896191 None] Lock "cinder-quobyte-b4ad5413-040f-403a-ab2f-bcce01b4046e" released by "delete_volume" :: held 1.416s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:30:06 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-c0d747ff-5fdd-45f8-8be1-dcce26062335 tempest-TestStampPattern-8896191 None] Created reservations ['3192b245-9a3d-4bbf-b755-2cc40f116e68', 'b1feaa6c-5480-4e2a-95fe-e7a7c6430459', '49048ff3-2e14-4b65-b35f-713bc6cb4cbd', 'b2a5adcf-d4a8-4ce1-921d-598afdf1100a'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:30:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c0d747ff-5fdd-45f8-8be1-dcce26062335 tempest-TestStampPattern-8896191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:30:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c0d747ff-5fdd-45f8-8be1-dcce26062335 tempest-TestStampPattern-8896191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:30:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c0d747ff-5fdd-45f8-8be1-dcce26062335 tempest-TestStampPattern-8896191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:30:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c0d747ff-5fdd-45f8-8be1-dcce26062335 tempest-TestStampPattern-8896191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:30:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c0d747ff-5fdd-45f8-8be1-dcce26062335 tempest-TestStampPattern-8896191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:30:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c0d747ff-5fdd-45f8-8be1-dcce26062335 tempest-TestStampPattern-8896191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:06 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:30:06 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:07 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c0d747ff-5fdd-45f8-8be1-dcce26062335 tempest-TestStampPattern-8896191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.636s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:07 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-c0d747ff-5fdd-45f8-8be1-dcce26062335 tempest-TestStampPattern-8896191 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:30:07 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-c0d747ff-5fdd-45f8-8be1-dcce26062335 tempest-TestStampPattern-8896191 None] Deleted volume successfully. Jul 10 18:30:07 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c0d747ff-5fdd-45f8-8be1-dcce26062335 tempest-TestStampPattern-8896191 None] Lock "cinder-b4ad5413-040f-403a-ab2f-bcce01b4046e-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:30:16 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=16,cinder:UPDATE=22,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:30:17 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=28,cinder:UPDATE=24,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:30:22 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:30:22 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] Flow 'volume_create_manager' (c5e41fca-98a2-4f52-9c8d-e50e2a2e7e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:30:22 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf58fe11-15a4-4db1-bfc5-038b5f871c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:22 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf58fe11-15a4-4db1-bfc5-038b5f871c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1616375778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1799508a-2559-444b-aff3-ab424cbb202b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bd328987cb34df1bc0d3a4e5051879b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:30:22Z,use_quota=True,user_id='e67f7321af174832a9445e71b798f02e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:22 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19921bdf-7438-4c77-a27a-6c70fcc11dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:22 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19921bdf-7438-4c77-a27a-6c70fcc11dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:22 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea6eda6-4aa4-4a73-9d6f-68ec2f08dbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:22 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea6eda6-4aa4-4a73-9d6f-68ec2f08dbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1799508a-2559-444b-aff3-ab424cbb202b', 'volume_name': 'volume-1799508a-2559-444b-aff3-ab424cbb202b', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:22 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc0e926-1d21-4b3e-9963-08976325cb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:22 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bc0e926-1d21-4b3e-9963-08976325cb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:22 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78256ef4-091c-4b01-81b1-0d5cc2439ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:22 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] Volume 1799508a-2559-444b-aff3-ab424cbb202b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1799508a-2559-444b-aff3-ab424cbb202b', 'volume_size': 1} Jul 10 18:30:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:30:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:30:22 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1616375778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1799508a-2559-444b-aff3-ab424cbb202b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bd328987cb34df1bc0d3a4e5051879b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:30:22Z,use_quota=True,user_id='e67f7321af174832a9445e71b798f02e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:30:22 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] Creating volume 1799508a-2559-444b-aff3-ab424cbb202b {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:30:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:30:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:30:22 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:30:22 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:30:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:30:22 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:30:22 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:30:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1799508a-2559-444b-aff3-ab424cbb202b 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:22 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1799508a-2559-444b-aff3-ab424cbb202b 1073741824 Jul 10 18:30:22 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:23 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1799508a-2559-444b-aff3-ab424cbb202b 1073741824" returned: 0 in 0.806s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1799508a-2559-444b-aff3-ab424cbb202b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:23 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1799508a-2559-444b-aff3-ab424cbb202b Jul 10 18:30:23 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:23 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1799508a-2559-444b-aff3-ab424cbb202b" returned: 0 in 0.626s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:23 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:30:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:30:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78256ef4-091c-4b01-81b1-0d5cc2439ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1799508a-2559-444b-aff3-ab424cbb202b', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f8fca57-64ee-4f58-b370-192ab59b7ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:24 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] Volume volume-1799508a-2559-444b-aff3-ab424cbb202b (1799508a-2559-444b-aff3-ab424cbb202b): created successfully Jul 10 18:30:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f8fca57-64ee-4f58-b370-192ab59b7ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] Flow 'volume_create_manager' (c5e41fca-98a2-4f52-9c8d-e50e2a2e7e0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:30:24 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-3b58a453-ad95-4e4d-a84f-55af39f12567 tempest-ProjectReaderTests-2106845881 None] Created volume successfully. Jul 10 18:30:24 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2b705c5f-0646-4625-9c48-c3d3fdeccc0f tempest-ProjectReaderTests-2106845881 None] Acquiring lock "cinder-1799508a-2559-444b-aff3-ab424cbb202b-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:30:24 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2b705c5f-0646-4625-9c48-c3d3fdeccc0f tempest-ProjectReaderTests-2106845881 None] Lock "cinder-1799508a-2559-444b-aff3-ab424cbb202b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:30:24 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2b705c5f-0646-4625-9c48-c3d3fdeccc0f tempest-ProjectReaderTests-2106845881 None] Acquiring lock "cinder-quobyte-1799508a-2559-444b-aff3-ab424cbb202b" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:30:24 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2b705c5f-0646-4625-9c48-c3d3fdeccc0f tempest-ProjectReaderTests-2106845881 None] Lock "cinder-quobyte-1799508a-2559-444b-aff3-ab424cbb202b" acquired by "delete_volume" :: waited 0.015s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:30:24 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[44848f29-b189-42e1-b347-dcca30d4f776]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:30:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2b705c5f-0646-4625-9c48-c3d3fdeccc0f tempest-ProjectReaderTests-2106845881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1799508a-2559-444b-aff3-ab424cbb202b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:24 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1799508a-2559-444b-aff3-ab424cbb202b Jul 10 18:30:24 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:25 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2b705c5f-0646-4625-9c48-c3d3fdeccc0f tempest-ProjectReaderTests-2106845881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1799508a-2559-444b-aff3-ab424cbb202b" returned: 0 in 0.756s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2b705c5f-0646-4625-9c48-c3d3fdeccc0f tempest-ProjectReaderTests-2106845881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1799508a-2559-444b-aff3-ab424cbb202b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:25 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1799508a-2559-444b-aff3-ab424cbb202b Jul 10 18:30:25 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:26 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2b705c5f-0646-4625-9c48-c3d3fdeccc0f tempest-ProjectReaderTests-2106845881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1799508a-2559-444b-aff3-ab424cbb202b" returned: 0 in 0.624s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:26 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2b705c5f-0646-4625-9c48-c3d3fdeccc0f tempest-ProjectReaderTests-2106845881 None] Lock "cinder-quobyte-1799508a-2559-444b-aff3-ab424cbb202b" released by "delete_volume" :: held 1.417s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:30:26 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-2b705c5f-0646-4625-9c48-c3d3fdeccc0f tempest-ProjectReaderTests-2106845881 None] Created reservations ['58540ea9-4d26-43de-8331-516567ee3e71', 'ef53f4d3-1fc4-4ce2-9e3c-8e64500ef2d6', '3736a3be-3353-4e49-8362-34a426e978d9', 'cdd80e3b-a069-474d-ab16-c110aa61bbe2'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:30:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2b705c5f-0646-4625-9c48-c3d3fdeccc0f tempest-ProjectReaderTests-2106845881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:30:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2b705c5f-0646-4625-9c48-c3d3fdeccc0f tempest-ProjectReaderTests-2106845881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:30:26 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-2b705c5f-0646-4625-9c48-c3d3fdeccc0f tempest-ProjectReaderTests-2106845881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:30:26 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-2b705c5f-0646-4625-9c48-c3d3fdeccc0f tempest-ProjectReaderTests-2106845881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:30:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2b705c5f-0646-4625-9c48-c3d3fdeccc0f tempest-ProjectReaderTests-2106845881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:30:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2b705c5f-0646-4625-9c48-c3d3fdeccc0f tempest-ProjectReaderTests-2106845881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:26 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:30:26 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:26 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2b705c5f-0646-4625-9c48-c3d3fdeccc0f tempest-ProjectReaderTests-2106845881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.622s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:26 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-2b705c5f-0646-4625-9c48-c3d3fdeccc0f tempest-ProjectReaderTests-2106845881 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:30:26 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-2b705c5f-0646-4625-9c48-c3d3fdeccc0f tempest-ProjectReaderTests-2106845881 None] Deleted volume successfully. Jul 10 18:30:26 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2b705c5f-0646-4625-9c48-c3d3fdeccc0f tempest-ProjectReaderTests-2106845881 None] Lock "cinder-1799508a-2559-444b-aff3-ab424cbb202b-delete_volume" released by "delete_volume" :: held 2.225s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:30:27 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:30:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] Flow 'volume_create_manager' (e7d9585e-523b-4b20-b4ef-7932e4dac97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:30:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3974a325-a658-4c05-aebc-a68afc925c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3974a325-a658-4c05-aebc-a68afc925c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-637812327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84492417-dcdd-450b-b4d0-a324fc9fdeb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bd328987cb34df1bc0d3a4e5051879b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:30:27Z,use_quota=True,user_id='e67f7321af174832a9445e71b798f02e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b004af1c-084c-4e9d-97d8-ce512bef30c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b004af1c-084c-4e9d-97d8-ce512bef30c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a998aa2-6a9d-450b-b1ea-233151c2d197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a998aa2-6a9d-450b-b1ea-233151c2d197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84492417-dcdd-450b-b4d0-a324fc9fdeb6', 'volume_name': 'volume-84492417-dcdd-450b-b4d0-a324fc9fdeb6', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62068b1d-5478-4afc-9862-a8f48b02cd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62068b1d-5478-4afc-9862-a8f48b02cd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:27 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1792fa97-c5d6-4afc-9af9-8c9ed88993df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:27 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] Volume 84492417-dcdd-450b-b4d0-a324fc9fdeb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84492417-dcdd-450b-b4d0-a324fc9fdeb6', 'volume_size': 1} Jul 10 18:30:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:30:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:30:27 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-637812327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84492417-dcdd-450b-b4d0-a324fc9fdeb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bd328987cb34df1bc0d3a4e5051879b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:30:27Z,use_quota=True,user_id='e67f7321af174832a9445e71b798f02e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:30:27 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] Creating volume 84492417-dcdd-450b-b4d0-a324fc9fdeb6 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:30:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:30:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:30:27 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:30:27 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:30:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:30:27 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:30:27 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:30:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-84492417-dcdd-450b-b4d0-a324fc9fdeb6 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:27 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-84492417-dcdd-450b-b4d0-a324fc9fdeb6 1073741824 Jul 10 18:30:27 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:28 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-84492417-dcdd-450b-b4d0-a324fc9fdeb6 1073741824" returned: 0 in 0.785s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-84492417-dcdd-450b-b4d0-a324fc9fdeb6 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:28 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-84492417-dcdd-450b-b4d0-a324fc9fdeb6 Jul 10 18:30:28 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:28 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-84492417-dcdd-450b-b4d0-a324fc9fdeb6" returned: 0 in 0.623s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:30:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:30:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1792fa97-c5d6-4afc-9af9-8c9ed88993df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84492417-dcdd-450b-b4d0-a324fc9fdeb6', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643428b6-af06-4469-839b-dc5500bfed9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:28 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] Volume volume-84492417-dcdd-450b-b4d0-a324fc9fdeb6 (84492417-dcdd-450b-b4d0-a324fc9fdeb6): created successfully Jul 10 18:30:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643428b6-af06-4469-839b-dc5500bfed9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] Flow 'volume_create_manager' (e7d9585e-523b-4b20-b4ef-7932e4dac97c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:30:28 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-e96ea125-26b7-4bd7-b289-a92cf73246ae tempest-ProjectReaderTests-2106845881 None] Created volume successfully. Jul 10 18:30:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-415fbd46-1b8d-4cae-981c-6b38097c43fe tempest-ProjectReaderTests-2106845881 None] Acquiring lock "cinder-84492417-dcdd-450b-b4d0-a324fc9fdeb6-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:30:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-415fbd46-1b8d-4cae-981c-6b38097c43fe tempest-ProjectReaderTests-2106845881 None] Lock "cinder-84492417-dcdd-450b-b4d0-a324fc9fdeb6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:30:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-415fbd46-1b8d-4cae-981c-6b38097c43fe tempest-ProjectReaderTests-2106845881 None] Acquiring lock "cinder-quobyte-84492417-dcdd-450b-b4d0-a324fc9fdeb6" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:30:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-415fbd46-1b8d-4cae-981c-6b38097c43fe tempest-ProjectReaderTests-2106845881 None] Lock "cinder-quobyte-84492417-dcdd-450b-b4d0-a324fc9fdeb6" acquired by "delete_volume" :: waited 0.014s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:30:29 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02884da-68f7-4449-9a75-5de31ff21539]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:30:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-415fbd46-1b8d-4cae-981c-6b38097c43fe tempest-ProjectReaderTests-2106845881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-84492417-dcdd-450b-b4d0-a324fc9fdeb6 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:29 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-84492417-dcdd-450b-b4d0-a324fc9fdeb6 Jul 10 18:30:29 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:30 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-415fbd46-1b8d-4cae-981c-6b38097c43fe tempest-ProjectReaderTests-2106845881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-84492417-dcdd-450b-b4d0-a324fc9fdeb6" returned: 0 in 0.737s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-415fbd46-1b8d-4cae-981c-6b38097c43fe tempest-ProjectReaderTests-2106845881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-84492417-dcdd-450b-b4d0-a324fc9fdeb6 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:30 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-84492417-dcdd-450b-b4d0-a324fc9fdeb6 Jul 10 18:30:30 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:30 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-415fbd46-1b8d-4cae-981c-6b38097c43fe tempest-ProjectReaderTests-2106845881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-84492417-dcdd-450b-b4d0-a324fc9fdeb6" returned: 0 in 0.644s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:30 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-415fbd46-1b8d-4cae-981c-6b38097c43fe tempest-ProjectReaderTests-2106845881 None] Lock "cinder-quobyte-84492417-dcdd-450b-b4d0-a324fc9fdeb6" released by "delete_volume" :: held 1.419s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:30:30 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-415fbd46-1b8d-4cae-981c-6b38097c43fe tempest-ProjectReaderTests-2106845881 None] Created reservations ['a3ae06fe-5105-440b-81a1-58e272d7f42d', '7dc067d3-1cee-4546-a74c-c5dd42fab2d4', 'c3e2b578-695c-4efb-862c-a22c30fbcccb', '3fd98196-84b5-48e1-b14b-608f831856cc'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:30:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-415fbd46-1b8d-4cae-981c-6b38097c43fe tempest-ProjectReaderTests-2106845881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:30:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-415fbd46-1b8d-4cae-981c-6b38097c43fe tempest-ProjectReaderTests-2106845881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:30:30 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-415fbd46-1b8d-4cae-981c-6b38097c43fe tempest-ProjectReaderTests-2106845881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:30:30 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-415fbd46-1b8d-4cae-981c-6b38097c43fe tempest-ProjectReaderTests-2106845881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:30:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-415fbd46-1b8d-4cae-981c-6b38097c43fe tempest-ProjectReaderTests-2106845881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:30:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-415fbd46-1b8d-4cae-981c-6b38097c43fe tempest-ProjectReaderTests-2106845881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:30 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:30:30 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:31 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-415fbd46-1b8d-4cae-981c-6b38097c43fe tempest-ProjectReaderTests-2106845881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.648s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:31 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-415fbd46-1b8d-4cae-981c-6b38097c43fe tempest-ProjectReaderTests-2106845881 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:30:31 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-415fbd46-1b8d-4cae-981c-6b38097c43fe tempest-ProjectReaderTests-2106845881 None] Deleted volume successfully. Jul 10 18:30:31 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-415fbd46-1b8d-4cae-981c-6b38097c43fe tempest-ProjectReaderTests-2106845881 None] Lock "cinder-84492417-dcdd-450b-b4d0-a324fc9fdeb6-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:30:32 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:30:32 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] Flow 'volume_create_manager' (9518c692-0500-4dd8-a17d-beb0d45a9b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:30:32 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62165705-e358-4014-b091-5ef85b782184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:32 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62165705-e358-4014-b091-5ef85b782184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1779635090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d0f98f0-16aa-4836-b8f0-110c16584c5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bd328987cb34df1bc0d3a4e5051879b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:30:32Z,use_quota=True,user_id='e67f7321af174832a9445e71b798f02e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:32 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36914559-e46a-4163-a040-4a9fbb25527f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:32 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36914559-e46a-4163-a040-4a9fbb25527f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:32 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9b7c094-da5a-47e2-a3c9-e10663733127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:32 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9b7c094-da5a-47e2-a3c9-e10663733127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d0f98f0-16aa-4836-b8f0-110c16584c5f', 'volume_name': 'volume-2d0f98f0-16aa-4836-b8f0-110c16584c5f', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:32 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f3db50-1cb9-4b81-8418-bb8d5b6b492a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:32 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f3db50-1cb9-4b81-8418-bb8d5b6b492a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:32 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37d54ec1-b32e-4f83-8d98-ee5010980be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:32 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] Volume 2d0f98f0-16aa-4836-b8f0-110c16584c5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d0f98f0-16aa-4836-b8f0-110c16584c5f', 'volume_size': 1} Jul 10 18:30:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:30:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:30:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:30:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1779635090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d0f98f0-16aa-4836-b8f0-110c16584c5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bd328987cb34df1bc0d3a4e5051879b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:30:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:30:32Z,use_quota=True,user_id='e67f7321af174832a9445e71b798f02e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:30:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] Creating volume 2d0f98f0-16aa-4836-b8f0-110c16584c5f {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:30:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:30:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:30:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:30:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:30:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:30:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:30:32 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:30:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2d0f98f0-16aa-4836-b8f0-110c16584c5f 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:32 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2d0f98f0-16aa-4836-b8f0-110c16584c5f 1073741824 Jul 10 18:30:32 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:32 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2d0f98f0-16aa-4836-b8f0-110c16584c5f 1073741824" returned: 0 in 0.792s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2d0f98f0-16aa-4836-b8f0-110c16584c5f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:32 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2d0f98f0-16aa-4836-b8f0-110c16584c5f Jul 10 18:30:32 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:33 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2d0f98f0-16aa-4836-b8f0-110c16584c5f" returned: 0 in 0.642s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:33 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] <== create_volume: return (1477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:30:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:30:33 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37d54ec1-b32e-4f83-8d98-ee5010980be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d0f98f0-16aa-4836-b8f0-110c16584c5f', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:33 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b2a0bf-7503-4dff-8a87-08eb9f17c545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:33 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] Volume volume-2d0f98f0-16aa-4836-b8f0-110c16584c5f (2d0f98f0-16aa-4836-b8f0-110c16584c5f): created successfully Jul 10 18:30:33 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b2a0bf-7503-4dff-8a87-08eb9f17c545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:33 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] Flow 'volume_create_manager' (9518c692-0500-4dd8-a17d-beb0d45a9b0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:30:33 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-1b1df7ab-c8a8-4032-97ce-d5e54e9db614 tempest-ProjectReaderTests-2106845881 None] Created volume successfully. Jul 10 18:30:34 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-55382d0a-b8b1-4034-9f26-f5868d66fe94 tempest-ProjectReaderTests-2106845881 None] Acquiring lock "cinder-2d0f98f0-16aa-4836-b8f0-110c16584c5f-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:30:34 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-55382d0a-b8b1-4034-9f26-f5868d66fe94 tempest-ProjectReaderTests-2106845881 None] Lock "cinder-2d0f98f0-16aa-4836-b8f0-110c16584c5f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:30:34 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-55382d0a-b8b1-4034-9f26-f5868d66fe94 tempest-ProjectReaderTests-2106845881 None] Acquiring lock "cinder-quobyte-2d0f98f0-16aa-4836-b8f0-110c16584c5f" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:30:34 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-55382d0a-b8b1-4034-9f26-f5868d66fe94 tempest-ProjectReaderTests-2106845881 None] Lock "cinder-quobyte-2d0f98f0-16aa-4836-b8f0-110c16584c5f" acquired by "delete_volume" :: waited 0.013s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:30:34 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[7866075b-0884-4e7f-b1a6-f43427a2dcde]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:30:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-55382d0a-b8b1-4034-9f26-f5868d66fe94 tempest-ProjectReaderTests-2106845881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2d0f98f0-16aa-4836-b8f0-110c16584c5f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:34 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2d0f98f0-16aa-4836-b8f0-110c16584c5f Jul 10 18:30:34 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:34 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-55382d0a-b8b1-4034-9f26-f5868d66fe94 tempest-ProjectReaderTests-2106845881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2d0f98f0-16aa-4836-b8f0-110c16584c5f" returned: 0 in 0.732s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-55382d0a-b8b1-4034-9f26-f5868d66fe94 tempest-ProjectReaderTests-2106845881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2d0f98f0-16aa-4836-b8f0-110c16584c5f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:34 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2d0f98f0-16aa-4836-b8f0-110c16584c5f Jul 10 18:30:34 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:35 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-55382d0a-b8b1-4034-9f26-f5868d66fe94 tempest-ProjectReaderTests-2106845881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2d0f98f0-16aa-4836-b8f0-110c16584c5f" returned: 0 in 0.656s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:35 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-55382d0a-b8b1-4034-9f26-f5868d66fe94 tempest-ProjectReaderTests-2106845881 None] Lock "cinder-quobyte-2d0f98f0-16aa-4836-b8f0-110c16584c5f" released by "delete_volume" :: held 1.426s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:30:35 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-55382d0a-b8b1-4034-9f26-f5868d66fe94 tempest-ProjectReaderTests-2106845881 None] Created reservations ['9a9fa039-50a8-4950-a8fe-8b0930b896d2', '55203193-7363-4653-8f6e-52f9ce71a721', 'fb92d143-4433-4d90-9387-7695e66d3843', 'b94cc1ee-1595-4f3b-8fa6-6ddc094e734c'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:30:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-55382d0a-b8b1-4034-9f26-f5868d66fe94 tempest-ProjectReaderTests-2106845881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:30:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-55382d0a-b8b1-4034-9f26-f5868d66fe94 tempest-ProjectReaderTests-2106845881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:30:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-55382d0a-b8b1-4034-9f26-f5868d66fe94 tempest-ProjectReaderTests-2106845881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:30:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-55382d0a-b8b1-4034-9f26-f5868d66fe94 tempest-ProjectReaderTests-2106845881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:30:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-55382d0a-b8b1-4034-9f26-f5868d66fe94 tempest-ProjectReaderTests-2106845881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:30:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-55382d0a-b8b1-4034-9f26-f5868d66fe94 tempest-ProjectReaderTests-2106845881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:35 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:30:35 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:36 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-55382d0a-b8b1-4034-9f26-f5868d66fe94 tempest-ProjectReaderTests-2106845881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.647s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:36 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-55382d0a-b8b1-4034-9f26-f5868d66fe94 tempest-ProjectReaderTests-2106845881 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:30:36 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-55382d0a-b8b1-4034-9f26-f5868d66fe94 tempest-ProjectReaderTests-2106845881 None] Deleted volume successfully. Jul 10 18:30:36 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-55382d0a-b8b1-4034-9f26-f5868d66fe94 tempest-ProjectReaderTests-2106845881 None] Lock "cinder-2d0f98f0-16aa-4836-b8f0-110c16584c5f-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:30:36 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:30:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] Flow 'volume_create_manager' (f85cb630-1367-42c5-a6fe-e22affb5cf14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:30:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d19ef00f-7bdb-4c52-8e30-b4d63248007e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d19ef00f-7bdb-4c52-8e30-b4d63248007e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2004632420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e56e2a8-3013-4b8c-9db8-6edbd9648e8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bd328987cb34df1bc0d3a4e5051879b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:30:37Z,use_quota=True,user_id='e67f7321af174832a9445e71b798f02e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a25d39f7-9a3a-4f82-b5b2-95706d1cdc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a25d39f7-9a3a-4f82-b5b2-95706d1cdc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0085d0cf-15a4-4e93-9e4e-ccad04dc29f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0085d0cf-15a4-4e93-9e4e-ccad04dc29f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e56e2a8-3013-4b8c-9db8-6edbd9648e8f', 'volume_name': 'volume-7e56e2a8-3013-4b8c-9db8-6edbd9648e8f', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa687a7d-21c2-48f3-99aa-722edff171af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa687a7d-21c2-48f3-99aa-722edff171af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7774aa6f-5ad9-419b-b5ef-b7a1fdb78f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:36 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] Volume 7e56e2a8-3013-4b8c-9db8-6edbd9648e8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e56e2a8-3013-4b8c-9db8-6edbd9648e8f', 'volume_size': 1} Jul 10 18:30:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:30:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:30:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:30:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2004632420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e56e2a8-3013-4b8c-9db8-6edbd9648e8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bd328987cb34df1bc0d3a4e5051879b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:30:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:30:37Z,use_quota=True,user_id='e67f7321af174832a9445e71b798f02e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:30:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] Creating volume 7e56e2a8-3013-4b8c-9db8-6edbd9648e8f {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:30:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:30:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:30:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:30:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:30:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:30:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:30:36 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:30:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7e56e2a8-3013-4b8c-9db8-6edbd9648e8f 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:36 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7e56e2a8-3013-4b8c-9db8-6edbd9648e8f 1073741824 Jul 10 18:30:36 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:37 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7e56e2a8-3013-4b8c-9db8-6edbd9648e8f 1073741824" returned: 0 in 0.785s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7e56e2a8-3013-4b8c-9db8-6edbd9648e8f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:37 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7e56e2a8-3013-4b8c-9db8-6edbd9648e8f Jul 10 18:30:37 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:38 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7e56e2a8-3013-4b8c-9db8-6edbd9648e8f" returned: 0 in 0.626s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:30:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:30:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7774aa6f-5ad9-419b-b5ef-b7a1fdb78f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e56e2a8-3013-4b8c-9db8-6edbd9648e8f', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a36772f-7b5a-432b-ae42-b656ecd3a3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:38 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] Volume volume-7e56e2a8-3013-4b8c-9db8-6edbd9648e8f (7e56e2a8-3013-4b8c-9db8-6edbd9648e8f): created successfully Jul 10 18:30:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a36772f-7b5a-432b-ae42-b656ecd3a3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] Flow 'volume_create_manager' (f85cb630-1367-42c5-a6fe-e22affb5cf14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:30:38 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-d8de90b2-4911-4349-b46c-0ad9bea04248 tempest-ProjectReaderTests-2106845881 None] Created volume successfully. Jul 10 18:30:38 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-545dd9a7-6113-4d85-9b53-2ce729350955 tempest-ProjectReaderTests-2106845881 None] Acquiring lock "cinder-7e56e2a8-3013-4b8c-9db8-6edbd9648e8f-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:30:38 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-545dd9a7-6113-4d85-9b53-2ce729350955 tempest-ProjectReaderTests-2106845881 None] Lock "cinder-7e56e2a8-3013-4b8c-9db8-6edbd9648e8f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:30:38 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-545dd9a7-6113-4d85-9b53-2ce729350955 tempest-ProjectReaderTests-2106845881 None] Acquiring lock "cinder-quobyte-7e56e2a8-3013-4b8c-9db8-6edbd9648e8f" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:30:38 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-545dd9a7-6113-4d85-9b53-2ce729350955 tempest-ProjectReaderTests-2106845881 None] Lock "cinder-quobyte-7e56e2a8-3013-4b8c-9db8-6edbd9648e8f" acquired by "delete_volume" :: waited 0.018s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:30:38 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3055c5-c85b-4c0e-a425-3ad560716592]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:30:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-545dd9a7-6113-4d85-9b53-2ce729350955 tempest-ProjectReaderTests-2106845881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7e56e2a8-3013-4b8c-9db8-6edbd9648e8f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:39 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7e56e2a8-3013-4b8c-9db8-6edbd9648e8f Jul 10 18:30:39 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:39 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-545dd9a7-6113-4d85-9b53-2ce729350955 tempest-ProjectReaderTests-2106845881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7e56e2a8-3013-4b8c-9db8-6edbd9648e8f" returned: 0 in 0.750s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-545dd9a7-6113-4d85-9b53-2ce729350955 tempest-ProjectReaderTests-2106845881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7e56e2a8-3013-4b8c-9db8-6edbd9648e8f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:39 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7e56e2a8-3013-4b8c-9db8-6edbd9648e8f Jul 10 18:30:39 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:40 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-545dd9a7-6113-4d85-9b53-2ce729350955 tempest-ProjectReaderTests-2106845881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-7e56e2a8-3013-4b8c-9db8-6edbd9648e8f" returned: 0 in 0.646s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:40 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-545dd9a7-6113-4d85-9b53-2ce729350955 tempest-ProjectReaderTests-2106845881 None] Lock "cinder-quobyte-7e56e2a8-3013-4b8c-9db8-6edbd9648e8f" released by "delete_volume" :: held 1.437s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:30:40 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-545dd9a7-6113-4d85-9b53-2ce729350955 tempest-ProjectReaderTests-2106845881 None] Created reservations ['48c18d04-9680-401b-8d98-61946c2ce7dd', 'e3aa6bc6-23fa-4031-8cf2-5854d0cd7476', '3a1f8d44-6ff0-4b48-864c-ec2621a6b90f', '4b2e38dc-cb29-4a09-ba30-091dfbdac35d'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:30:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-545dd9a7-6113-4d85-9b53-2ce729350955 tempest-ProjectReaderTests-2106845881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:30:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-545dd9a7-6113-4d85-9b53-2ce729350955 tempest-ProjectReaderTests-2106845881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:30:40 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-545dd9a7-6113-4d85-9b53-2ce729350955 tempest-ProjectReaderTests-2106845881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:30:40 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-545dd9a7-6113-4d85-9b53-2ce729350955 tempest-ProjectReaderTests-2106845881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:30:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-545dd9a7-6113-4d85-9b53-2ce729350955 tempest-ProjectReaderTests-2106845881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:30:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-545dd9a7-6113-4d85-9b53-2ce729350955 tempest-ProjectReaderTests-2106845881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:40 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:30:40 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:41 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-545dd9a7-6113-4d85-9b53-2ce729350955 tempest-ProjectReaderTests-2106845881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.644s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:41 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-545dd9a7-6113-4d85-9b53-2ce729350955 tempest-ProjectReaderTests-2106845881 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:30:41 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-545dd9a7-6113-4d85-9b53-2ce729350955 tempest-ProjectReaderTests-2106845881 None] Deleted volume successfully. Jul 10 18:30:41 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-545dd9a7-6113-4d85-9b53-2ce729350955 tempest-ProjectReaderTests-2106845881 None] Lock "cinder-7e56e2a8-3013-4b8c-9db8-6edbd9648e8f-delete_volume" released by "delete_volume" :: held 2.281s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:30:50 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=26,cinder:UPDATE=43,cinder:INSERT=8,cinder:DELETE=4 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:30:51 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=30,cinder:UPDATE=45,cinder:INSERT=12,cinder:DELETE=4 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:30:52 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:30:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] Flow 'volume_create_manager' (092c0c6e-aab4-4f74-942c-ba2475fff0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:30:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da32cbb2-a727-4f39-be71-54c9d5063c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da32cbb2-a727-4f39-be71-54c9d5063c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1487528484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d420ca51e1454ead8806f4fc6df8cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:30:52Z,use_quota=True,user_id='07442683970242d0bf37e6202277d131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22dda3d0-e9b9-41db-ba3c-f961765fec5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22dda3d0-e9b9-41db-ba3c-f961765fec5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c80c30c1-133c-4ed1-a3ca-d616d71d8f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c80c30c1-133c-4ed1-a3ca-d616d71d8f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2', 'volume_name': 'volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d1a9408-6cf4-4b51-92bb-8acfd2c80bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d1a9408-6cf4-4b51-92bb-8acfd2c80bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b394c255-0058-4018-ad4f-666d508aac83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:52 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] Volume 42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2', 'volume_size': 1} Jul 10 18:30:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:30:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:30:52 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1487528484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d420ca51e1454ead8806f4fc6df8cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:30:52Z,use_quota=True,user_id='07442683970242d0bf37e6202277d131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:30:52 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] Creating volume 42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:30:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:30:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:30:52 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:30:52 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:30:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:30:52 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:30:52 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:30:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:52 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2 1073741824 Jul 10 18:30:52 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] Flow 'volume_create_manager' (db326e16-4dc4-4085-a4cd-da741b50dffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e473e822-ce58-481b-b231-f4dfe31bf7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e473e822-ce58-481b-b231-f4dfe31bf7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1988277211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9720671c-641a-49c2-acb0-a3c502a61d93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbbefa2e79fa45f6893e5f1ed789a47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:30:53Z,use_quota=True,user_id='611adf05624a48d1b579cfbdb2c41f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4435b5ad-f610-4158-9483-5a130806570d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4435b5ad-f610-4158-9483-5a130806570d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6272a0d-1e7b-496e-aa44-5531850e2734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6272a0d-1e7b-496e-aa44-5531850e2734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9720671c-641a-49c2-acb0-a3c502a61d93', 'volume_name': 'volume-9720671c-641a-49c2-acb0-a3c502a61d93', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5412c030-286f-465b-8303-164ebd31cad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5412c030-286f-465b-8303-164ebd31cad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7447123d-2d09-4c99-8816-303473dfa812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:53 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] Volume 9720671c-641a-49c2-acb0-a3c502a61d93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9720671c-641a-49c2-acb0-a3c502a61d93', 'volume_size': 1} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] Flow 'volume_create_manager' (1e028da9-43b2-4fe4-8ad1-c205aeaa26ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (892011b6-50e2-402e-b621-9ef074de0f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (892011b6-50e2-402e-b621-9ef074de0f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1660660767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f04eb46e-3fb5-4f3e-8c91-f64625eb2c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b3e1fb9845344a0967bccc11adc1048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:30:53Z,use_quota=True,user_id='69e533c9f6264426a230547b1c7deacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9d3347f-a8f3-4026-b4c1-12ec4ff7e5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9d3347f-a8f3-4026-b4c1-12ec4ff7e5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33db03b4-2ac7-4c39-8a5f-0690b26544fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33db03b4-2ac7-4c39-8a5f-0690b26544fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f04eb46e-3fb5-4f3e-8c91-f64625eb2c81', 'volume_name': 'volume-f04eb46e-3fb5-4f3e-8c91-f64625eb2c81', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c72492bf-73d9-4e53-bdd1-5f2fe25ec885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c72492bf-73d9-4e53-bdd1-5f2fe25ec885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1669e367-74f2-42f0-9063-ad58a596c3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:53 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] Volume f04eb46e-3fb5-4f3e-8c91-f64625eb2c81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f04eb46e-3fb5-4f3e-8c91-f64625eb2c81', 'volume_size': 1} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] Flow 'volume_create_manager' (13f67828-70e2-4800-aadc-a7960425e4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dbae8fb-684c-4111-a54e-5fd4a34bfcaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:53 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2 1073741824" returned: 0 in 1.170s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dbae8fb-684c-4111-a54e-5fd4a34bfcaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-360019761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac6cc643-f077-415a-ae30-c3b676ba7d3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b3e1fb9845344a0967bccc11adc1048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:30:54Z,use_quota=True,user_id='69e533c9f6264426a230547b1c7deacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b7384ee-4da1-4376-862e-ee4957400772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b7384ee-4da1-4376-862e-ee4957400772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915eeace-574f-4803-b633-7ebf84b3f0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915eeace-574f-4803-b633-7ebf84b3f0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac6cc643-f077-415a-ae30-c3b676ba7d3c', 'volume_name': 'volume-ac6cc643-f077-415a-ae30-c3b676ba7d3c', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0da0b9f2-b20e-4cb9-a79a-fd51eb777537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0da0b9f2-b20e-4cb9-a79a-fd51eb777537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65e8962-d13c-4f8f-8090-7e827ee54652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:53 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] Volume ac6cc643-f077-415a-ae30-c3b676ba7d3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac6cc643-f077-415a-ae30-c3b676ba7d3c', 'volume_size': 1} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:30:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:53 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2 Jul 10 18:30:53 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] Flow 'volume_create_manager' (69d1fd59-8a69-4815-8b2f-aab7a117aafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d780f1d-40ba-42a3-b331-6373d71355bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d780f1d-40ba-42a3-b331-6373d71355bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1987116160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e711bbba-5bc6-4e18-96ab-15e2e1891ef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b3e1fb9845344a0967bccc11adc1048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:30:54Z,use_quota=True,user_id='69e533c9f6264426a230547b1c7deacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fdf5dcd-bcf5-4d4f-94a7-d3a5e2cb46d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fdf5dcd-bcf5-4d4f-94a7-d3a5e2cb46d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e1e1fc-0d66-4bd6-9d15-1bb5605eb893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18e1e1fc-0d66-4bd6-9d15-1bb5605eb893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e711bbba-5bc6-4e18-96ab-15e2e1891ef3', 'volume_name': 'volume-e711bbba-5bc6-4e18-96ab-15e2e1891ef3', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c8e28a-d4f5-4aed-8af6-522260e90fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c8e28a-d4f5-4aed-8af6-522260e90fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (488d8f03-4061-49a6-922c-93768db274fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:54 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] Volume e711bbba-5bc6-4e18-96ab-15e2e1891ef3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e711bbba-5bc6-4e18-96ab-15e2e1891ef3', 'volume_size': 1} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] Flow 'volume_create_manager' (21ffb022-89c2-46e6-a4c3-a2512ef51126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d38d3f80-bcda-4df7-8bfd-608e200603df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d38d3f80-bcda-4df7-8bfd-608e200603df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-765347858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6b3887d-97fb-43c0-86a6-bc120a7f0f38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b3e1fb9845344a0967bccc11adc1048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:30:55Z,use_quota=True,user_id='69e533c9f6264426a230547b1c7deacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82bcf50f-7632-4d99-a54a-0ee56acb67da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82bcf50f-7632-4d99-a54a-0ee56acb67da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c10c08d-0492-4616-b5bb-6e732559122f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c10c08d-0492-4616-b5bb-6e732559122f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6b3887d-97fb-43c0-86a6-bc120a7f0f38', 'volume_name': 'volume-e6b3887d-97fb-43c0-86a6-bc120a7f0f38', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a36174cd-8903-405d-ab3d-5a41e4173c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a36174cd-8903-405d-ab3d-5a41e4173c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a8f952-7a3a-4638-b0a5-46d870a3a30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:54 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] Volume e6b3887d-97fb-43c0-86a6-bc120a7f0f38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6b3887d-97fb-43c0-86a6-bc120a7f0f38', 'volume_size': 1} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:30:54 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2" returned: 0 in 0.783s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] <== create_volume: return (2080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.082s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.516s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1988277211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9720671c-641a-49c2-acb0-a3c502a61d93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbbefa2e79fa45f6893e5f1ed789a47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:30:53Z,use_quota=True,user_id='611adf05624a48d1b579cfbdb2c41f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] Creating volume 9720671c-641a-49c2-acb0-a3c502a61d93 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:30:54 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:54 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93 1073741824 Jul 10 18:30:54 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b394c255-0058-4018-ad4f-666d508aac83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (940d34b1-94f1-4adf-9ba2-ea23f94c0be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:54 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] Volume volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2 (42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2): created successfully Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (940d34b1-94f1-4adf-9ba2-ea23f94c0be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:54 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] Flow 'volume_create_manager' (092c0c6e-aab4-4f74-942c-ba2475fff0ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:30:54 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-6836a97e-400a-4b09-8392-119a143b1dcd tempest-VolumeDependencyTests-476431000 None] Created volume successfully. Jul 10 18:30:55 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:30:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] Flow 'volume_create_manager' (66f25dd4-8c17-4203-9b8b-2ed2c5071339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:30:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (119fffdb-82dc-4142-93ff-5c870182579e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (119fffdb-82dc-4142-93ff-5c870182579e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1348921873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e25ab822-0332-40fd-a2c3-6d0c5e8f8f47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b3e1fb9845344a0967bccc11adc1048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:30:55Z,use_quota=True,user_id='69e533c9f6264426a230547b1c7deacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1781075a-d693-449b-ba7f-9d28dac0624e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1781075a-d693-449b-ba7f-9d28dac0624e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475d897d-e5e9-4691-ab70-f5c3d83e11aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475d897d-e5e9-4691-ab70-f5c3d83e11aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e25ab822-0332-40fd-a2c3-6d0c5e8f8f47', 'volume_name': 'volume-e25ab822-0332-40fd-a2c3-6d0c5e8f8f47', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb50b0a3-3aa2-4ab9-95ef-ee1d1abae8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb50b0a3-3aa2-4ab9-95ef-ee1d1abae8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b79edf-5d93-4ed3-ae50-bd8e156d5855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:55 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] Volume e25ab822-0332-40fd-a2c3-6d0c5e8f8f47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e25ab822-0332-40fd-a2c3-6d0c5e8f8f47', 'volume_size': 1} Jul 10 18:30:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:30:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-68388ce5-6749-4997-9e23-d182c0a23f20 tempest-VolumeDependencyTests-476431000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:30:55 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93 1073741824" returned: 0 in 0.952s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:55 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93 Jul 10 18:30:55 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:56 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93" returned: 0 in 0.674s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:30:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:30:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.853s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:30:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1660660767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f04eb46e-3fb5-4f3e-8c91-f64625eb2c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b3e1fb9845344a0967bccc11adc1048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:30:53Z,use_quota=True,user_id='69e533c9f6264426a230547b1c7deacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:30:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] Creating volume f04eb46e-3fb5-4f3e-8c91-f64625eb2c81 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:30:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:30:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:30:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:30:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:30:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:30:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:30:56 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:30:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f04eb46e-3fb5-4f3e-8c91-f64625eb2c81 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:56 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7447123d-2d09-4c99-8816-303473dfa812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9720671c-641a-49c2-acb0-a3c502a61d93', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:56 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f7cc67-7075-4c0e-aceb-aa1f7eaae32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:56 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f04eb46e-3fb5-4f3e-8c91-f64625eb2c81 1073741824 Jul 10 18:30:56 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:56 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] Volume volume-9720671c-641a-49c2-acb0-a3c502a61d93 (9720671c-641a-49c2-acb0-a3c502a61d93): created successfully Jul 10 18:30:56 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f7cc67-7075-4c0e-aceb-aa1f7eaae32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:56 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] Flow 'volume_create_manager' (db326e16-4dc4-4085-a4cd-da741b50dffd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:30:56 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-4a844959-4d36-4139-82ab-80213042ae3c tempest-CreateVolumesFromSnapshotTest-2132304058 None] Created volume successfully. Jul 10 18:30:56 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:30:56 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Flow 'volume_create_manager' (1becbf4d-ec7c-40c2-8ce0-bb310456a83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:30:56 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f462e0c1-eea2-4704-8cf6-0607a4145a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:56 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f462e0c1-eea2-4704-8cf6-0607a4145a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c259f7e4-c3dc-4741-af8b-5bb2d15b5056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca8519c67d14a049008a764de4ea95f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:30:57Z,use_quota=True,user_id='9ec2bfc9497e4278abc9fd0b1b5ad2e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb5556f5-5c74-4ccf-b381-01b02da8a38c),volume_type_id=fb5556f5-5c74-4ccf-b381-01b02da8a38c)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:56 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43932212-c2da-41d6-a942-1494b547d142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:56 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43932212-c2da-41d6-a942-1494b547d142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:56 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c2f25c-905e-42e0-a9b6-d07a5bf7da46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:56 devstack cinder-volume[87399]: DEBUG cinder.image.glance [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Creating Keystone auth plugin from conf {{(pid=87399) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 18:30:57 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c2f25c-905e-42e0-a9b6-d07a5bf7da46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c259f7e4-c3dc-4741-af8b-5bb2d15b5056', 'volume_name': 'volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056', 'volume_size': 1, 'image_id': 'a382e9ed-ee84-4515-9e0a-8eb8922a72ce', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a382e9ed-ee84-4515-9e0a-8eb8922a72ce', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f81a8ff11fec90b6e5041b0ac9c7483c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9ca8519c67d14a049008a764de4ea95f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b789dd6324b0a6b7b14ac7ea9ccb4b559aee1f85f892a87cb39330101e527c2743de3e75a8244dc286098162d4df0c73d2fbf272e59a0af5fa8dadf41773f346', 'id': 'a382e9ed-ee84-4515-9e0a-8eb8922a72ce', 'created_at': datetime.datetime(2026, 7, 10, 16, 30, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 16, 30, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a382e9ed-ee84-4515-9e0a-8eb8922a72ce/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:57 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4271571f-7fa0-4c61-8323-b5eae83f6e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:57 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4271571f-7fa0-4c61-8323-b5eae83f6e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:57 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4310ee35-7ae5-4055-b447-74decc5d602f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:57 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Volume c259f7e4-c3dc-4741-af8b-5bb2d15b5056: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056', 'volume_size': 1, 'image_id': 'a382e9ed-ee84-4515-9e0a-8eb8922a72ce', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a382e9ed-ee84-4515-9e0a-8eb8922a72ce', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f81a8ff11fec90b6e5041b0ac9c7483c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9ca8519c67d14a049008a764de4ea95f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b789dd6324b0a6b7b14ac7ea9ccb4b559aee1f85f892a87cb39330101e527c2743de3e75a8244dc286098162d4df0c73d2fbf272e59a0af5fa8dadf41773f346', 'id': 'a382e9ed-ee84-4515-9e0a-8eb8922a72ce', 'created_at': datetime.datetime(2026, 7, 10, 16, 30, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 16, 30, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a382e9ed-ee84-4515-9e0a-8eb8922a72ce/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 10 18:30:57 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Trying to clone c259f7e4-c3dc-4741-af8b-5bb2d15b5056 from image a382e9ed-ee84-4515-9e0a-8eb8922a72ce at location (None, [{'url': 'file:///opt/stack/data/glance/images/a382e9ed-ee84-4515-9e0a-8eb8922a72ce', 'metadata': {}}]). {{(pid=87399) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 18:30:57 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f04eb46e-3fb5-4f3e-8c91-f64625eb2c81 1073741824" returned: 0 in 0.900s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f04eb46e-3fb5-4f3e-8c91-f64625eb2c81 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:57 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f04eb46e-3fb5-4f3e-8c91-f64625eb2c81 Jul 10 18:30:57 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:57 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a382e9ed-ee84-4515-9e0a-8eb8922a72ce_wwh2mmj0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87399) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 18:30:57 devstack cinder-volume[87399]: INFO cinder.image.image_utils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Image download 0.00 MB at 0.00 MB/s Jul 10 18:30:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5a3b6c20-5168-454f-bd01-2e2dea023c47 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:30:57 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f88112-4675-455c-bcde-777531b03c96]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:30:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a382e9ed-ee84-4515-9e0a-8eb8922a72ce_wwh2mmj0devstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:57 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:30:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:30:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:30:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:30:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:30:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:30:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:57 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:30:57 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:57 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a382e9ed-ee84-4515-9e0a-8eb8922a72ce_wwh2mmj0devstack@QuobyteHD Jul 10 18:30:57 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:58 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f04eb46e-3fb5-4f3e-8c91-f64625eb2c81" returned: 0 in 0.679s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] <== create_volume: return (1639ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:30:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:30:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.165s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:30:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-360019761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac6cc643-f077-415a-ae30-c3b676ba7d3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b3e1fb9845344a0967bccc11adc1048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:30:54Z,use_quota=True,user_id='69e533c9f6264426a230547b1c7deacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:30:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] Creating volume ac6cc643-f077-415a-ae30-c3b676ba7d3c {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:30:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:30:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:30:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:30:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:30:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:30:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:30:58 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:30:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ac6cc643-f077-415a-ae30-c3b676ba7d3c 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1669e367-74f2-42f0-9063-ad58a596c3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f04eb46e-3fb5-4f3e-8c91-f64625eb2c81', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1172cf37-9a0d-4acc-a86c-8175af866a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:58 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ac6cc643-f077-415a-ae30-c3b676ba7d3c 1073741824 Jul 10 18:30:58 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:58 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] Volume volume-f04eb46e-3fb5-4f3e-8c91-f64625eb2c81 (f04eb46e-3fb5-4f3e-8c91-f64625eb2c81): created successfully Jul 10 18:30:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1172cf37-9a0d-4acc-a86c-8175af866a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] Flow 'volume_create_manager' (1e028da9-43b2-4fe4-8ad1-c205aeaa26ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:30:58 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-6d0fb85d-21cf-472f-8558-47d7e728d386 tempest-CreateVolumesFromImageTest-415340918 None] Created volume successfully. Jul 10 18:30:58 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.652s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:58 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:30:58 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager._thread_info {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:30:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread count: 28 {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 18:30:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread info: [<_MainThread(MainThread, started 139757428633728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 18:30:58 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a382e9ed-ee84-4515-9e0a-8eb8922a72ce_wwh2mmj0devstack@QuobyteHD" returned: 0 in 0.769s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a382e9ed-ee84-4515-9e0a-8eb8922a72ce_wwh2mmj0devstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:58 devstack sudo[106005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a382e9ed-ee84-4515-9e0a-8eb8922a72ce_wwh2mmj0devstack@QuobyteHD Jul 10 18:30:58 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:58 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ac6cc643-f077-415a-ae30-c3b676ba7d3c 1073741824" returned: 0 in 0.839s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ac6cc643-f077-415a-ae30-c3b676ba7d3c {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:58 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ac6cc643-f077-415a-ae30-c3b676ba7d3c Jul 10 18:30:58 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:59 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a382e9ed-ee84-4515-9e0a-8eb8922a72ce_wwh2mmj0devstack@QuobyteHD" returned: 1 in 0.797s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a382e9ed-ee84-4515-9e0a-8eb8922a72ce_wwh2mmj0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:30:59 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Temporary image a382e9ed-ee84-4515-9e0a-8eb8922a72ce is fetched for user 9ec2bfc9497e4278abc9fd0b1b5ad2e5. {{(pid=87399) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 18:30:59 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b17cb25-7b8e-4fcf-afa7-c174c3d7eea1]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:30:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a382e9ed-ee84-4515-9e0a-8eb8922a72ce_wwh2mmj0devstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:59 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a382e9ed-ee84-4515-9e0a-8eb8922a72ce_wwh2mmj0devstack@QuobyteHD Jul 10 18:30:59 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:59 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ac6cc643-f077-415a-ae30-c3b676ba7d3c" returned: 0 in 0.646s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:59 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:30:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:30:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.344s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:30:59 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1987116160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e711bbba-5bc6-4e18-96ab-15e2e1891ef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b3e1fb9845344a0967bccc11adc1048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:30:54Z,use_quota=True,user_id='69e533c9f6264426a230547b1c7deacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:30:59 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] Creating volume e711bbba-5bc6-4e18-96ab-15e2e1891ef3 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:30:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:30:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:30:59 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:30:59 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:30:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:30:59 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:30:59 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:30:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e711bbba-5bc6-4e18-96ab-15e2e1891ef3 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:30:59 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e711bbba-5bc6-4e18-96ab-15e2e1891ef3 1073741824 Jul 10 18:30:59 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:30:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b65e8962-d13c-4f8f-8090-7e827ee54652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac6cc643-f077-415a-ae30-c3b676ba7d3c', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (367b4788-4065-4b9d-b98f-6901cccdf57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:30:59 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] Volume volume-ac6cc643-f077-415a-ae30-c3b676ba7d3c (ac6cc643-f077-415a-ae30-c3b676ba7d3c): created successfully Jul 10 18:30:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (367b4788-4065-4b9d-b98f-6901cccdf57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:30:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] Flow 'volume_create_manager' (13f67828-70e2-4800-aadc-a7960425e4ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:30:59 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-44e62215-948d-45e2-bfc0-24526da06388 tempest-CreateVolumesFromImageTest-415340918 None] Created volume successfully. Jul 10 18:30:59 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Jul 10 18:30:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a382e9ed-ee84-4515-9e0a-8eb8922a72ce_wwh2mmj0devstack@QuobyteHD" returned: 0 in 0.766s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:30:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a382e9ed-ee84-4515-9e0a-8eb8922a72ce_wwh2mmj0devstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:00 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a382e9ed-ee84-4515-9e0a-8eb8922a72ce_wwh2mmj0devstack@QuobyteHD Jul 10 18:31:00 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:00 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e711bbba-5bc6-4e18-96ab-15e2e1891ef3 1073741824" returned: 0 in 0.834s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e711bbba-5bc6-4e18-96ab-15e2e1891ef3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:00 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e711bbba-5bc6-4e18-96ab-15e2e1891ef3 Jul 10 18:31:00 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:00 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a382e9ed-ee84-4515-9e0a-8eb8922a72ce_wwh2mmj0devstack@QuobyteHD" returned: 1 in 0.767s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a382e9ed-ee84-4515-9e0a-8eb8922a72ce_wwh2mmj0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:31:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:01 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e711bbba-5bc6-4e18-96ab-15e2e1891ef3" returned: 0 in 0.628s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:01 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:31:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.459s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:01 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-765347858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6b3887d-97fb-43c0-86a6-bc120a7f0f38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b3e1fb9845344a0967bccc11adc1048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:30:55Z,use_quota=True,user_id='69e533c9f6264426a230547b1c7deacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:31:01 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] Creating volume e6b3887d-97fb-43c0-86a6-bc120a7f0f38 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:31:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:01 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:01 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:01 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:31:01 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:31:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e6b3887d-97fb-43c0-86a6-bc120a7f0f38 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:01 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e6b3887d-97fb-43c0-86a6-bc120a7f0f38 1073741824 Jul 10 18:31:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (488d8f03-4061-49a6-922c-93768db274fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e711bbba-5bc6-4e18-96ab-15e2e1891ef3', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:01 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93bc05bb-6db3-42c2-9ea4-1c03d62db335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:01 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] Volume volume-e711bbba-5bc6-4e18-96ab-15e2e1891ef3 (e711bbba-5bc6-4e18-96ab-15e2e1891ef3): created successfully Jul 10 18:31:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93bc05bb-6db3-42c2-9ea4-1c03d62db335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] Flow 'volume_create_manager' (69d1fd59-8a69-4815-8b2f-aab7a117aafb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:31:01 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-ec8ca306-8eaa-4560-beb9-9a6c631a1a31 tempest-CreateVolumesFromImageTest-415340918 None] Created volume successfully. Jul 10 18:31:01 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e6b3887d-97fb-43c0-86a6-bc120a7f0f38 1073741824" returned: 0 in 0.838s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e6b3887d-97fb-43c0-86a6-bc120a7f0f38 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:02 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e6b3887d-97fb-43c0-86a6-bc120a7f0f38 Jul 10 18:31:02 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:02 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e6b3887d-97fb-43c0-86a6-bc120a7f0f38" returned: 0 in 0.628s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:31:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.455s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1348921873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e25ab822-0332-40fd-a2c3-6d0c5e8f8f47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b3e1fb9845344a0967bccc11adc1048',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:30:55Z,use_quota=True,user_id='69e533c9f6264426a230547b1c7deacb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:31:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] Creating volume e25ab822-0332-40fd-a2c3-6d0c5e8f8f47 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:31:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:31:02 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:31:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e25ab822-0332-40fd-a2c3-6d0c5e8f8f47 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:02 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e25ab822-0332-40fd-a2c3-6d0c5e8f8f47 1073741824 Jul 10 18:31:02 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a8f952-7a3a-4638-b0a5-46d870a3a30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6b3887d-97fb-43c0-86a6-bc120a7f0f38', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:02 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:02 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b682b9-f010-4b89-a0a4-478cec8022aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:02 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] Volume volume-e6b3887d-97fb-43c0-86a6-bc120a7f0f38 (e6b3887d-97fb-43c0-86a6-bc120a7f0f38): created successfully Jul 10 18:31:02 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0b682b9-f010-4b89-a0a4-478cec8022aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:02 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] Flow 'volume_create_manager' (21ffb022-89c2-46e6-a4c3-a2512ef51126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:31:02 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-deb21f9c-a86b-45e0-bc22-3b4b2bb77377 tempest-CreateVolumesFromImageTest-415340918 None] Created volume successfully. Jul 10 18:31:03 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e25ab822-0332-40fd-a2c3-6d0c5e8f8f47 1073741824" returned: 0 in 0.791s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e25ab822-0332-40fd-a2c3-6d0c5e8f8f47 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:03 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e25ab822-0332-40fd-a2c3-6d0c5e8f8f47 Jul 10 18:31:03 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:04 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e25ab822-0332-40fd-a2c3-6d0c5e8f8f47" returned: 0 in 0.648s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:04 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] <== create_volume: return (1477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:31:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-68388ce5-6749-4997-9e23-d182c0a23f20 tempest-VolumeDependencyTests-476431000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.796s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b79edf-5d93-4ed3-ae50-bd8e156d5855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e25ab822-0332-40fd-a2c3-6d0c5e8f8f47', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af25b202-f1fd-4a6c-a538-6d10a0647c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:04 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-68388ce5-6749-4997-9e23-d182c0a23f20 tempest-VolumeDependencyTests-476431000 None] Creating offline snapshot 7e258c68-33a7-4846-ba4a-43e47e8f20e3 of volume 42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2 {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:31:04 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] Volume volume-e25ab822-0332-40fd-a2c3-6d0c5e8f8f47 (e25ab822-0332-40fd-a2c3-6d0c5e8f8f47): created successfully Jul 10 18:31:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af25b202-f1fd-4a6c-a538-6d10a0647c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] Flow 'volume_create_manager' (66f25dd4-8c17-4203-9b8b-2ed2c5071339) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:31:04 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[22776d41-c998-40b2-aa83-b61cd3db26b5]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-68388ce5-6749-4997-9e23-d182c0a23f20 tempest-VolumeDependencyTests-476431000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:04 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-e74075c1-176b-4a8b-b16b-dd976e4930f1 tempest-CreateVolumesFromImageTest-415340918 None] Created volume successfully. Jul 10 18:31:04 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2 Jul 10 18:31:04 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:04 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-dfe09efc-ed33-4902-9410-c54cc828fc71 tempest-CreateVolumesFromImageTest-415340918 None] Acquiring lock "cinder-e25ab822-0332-40fd-a2c3-6d0c5e8f8f47-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:04 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-dfe09efc-ed33-4902-9410-c54cc828fc71 tempest-CreateVolumesFromImageTest-415340918 None] Lock "cinder-e25ab822-0332-40fd-a2c3-6d0c5e8f8f47-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:04 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-dfe09efc-ed33-4902-9410-c54cc828fc71 tempest-CreateVolumesFromImageTest-415340918 None] Acquiring lock "cinder-quobyte-e25ab822-0332-40fd-a2c3-6d0c5e8f8f47" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:04 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-dfe09efc-ed33-4902-9410-c54cc828fc71 tempest-CreateVolumesFromImageTest-415340918 None] Lock "cinder-quobyte-e25ab822-0332-40fd-a2c3-6d0c5e8f8f47" acquired by "delete_volume" :: waited 0.017s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:04 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ce8b06-6e1f-43a1-bb95-24462938d378]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-dfe09efc-ed33-4902-9410-c54cc828fc71 tempest-CreateVolumesFromImageTest-415340918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e25ab822-0332-40fd-a2c3-6d0c5e8f8f47 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:04 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-68388ce5-6749-4997-9e23-d182c0a23f20 tempest-VolumeDependencyTests-476431000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2" returned: 0 in 0.790s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-68388ce5-6749-4997-9e23-d182c0a23f20 tempest-VolumeDependencyTests-476431000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2.7e258c68-33a7-4846-ba4a-43e47e8f20e3 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:04 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2.7e258c68-33a7-4846-ba4a-43e47e8f20e3 1G Jul 10 18:31:04 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:05 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e25ab822-0332-40fd-a2c3-6d0c5e8f8f47 Jul 10 18:31:05 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:05 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-dfe09efc-ed33-4902-9410-c54cc828fc71 tempest-CreateVolumesFromImageTest-415340918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e25ab822-0332-40fd-a2c3-6d0c5e8f8f47" returned: 0 in 0.775s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-dfe09efc-ed33-4902-9410-c54cc828fc71 tempest-CreateVolumesFromImageTest-415340918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e25ab822-0332-40fd-a2c3-6d0c5e8f8f47 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:05 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e25ab822-0332-40fd-a2c3-6d0c5e8f8f47 Jul 10 18:31:05 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:05 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-68388ce5-6749-4997-9e23-d182c0a23f20 tempest-VolumeDependencyTests-476431000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2.7e258c68-33a7-4846-ba4a-43e47e8f20e3 1G" returned: 0 in 0.790s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-68388ce5-6749-4997-9e23-d182c0a23f20 tempest-VolumeDependencyTests-476431000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2.7e258c68-33a7-4846-ba4a-43e47e8f20e3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:05 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2.7e258c68-33a7-4846-ba4a-43e47e8f20e3 Jul 10 18:31:05 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:06 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-dfe09efc-ed33-4902-9410-c54cc828fc71 tempest-CreateVolumesFromImageTest-415340918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e25ab822-0332-40fd-a2c3-6d0c5e8f8f47" returned: 0 in 0.646s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:06 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-dfe09efc-ed33-4902-9410-c54cc828fc71 tempest-CreateVolumesFromImageTest-415340918 None] Lock "cinder-quobyte-e25ab822-0332-40fd-a2c3-6d0c5e8f8f47" released by "delete_volume" :: held 1.464s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:06 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-dfe09efc-ed33-4902-9410-c54cc828fc71 tempest-CreateVolumesFromImageTest-415340918 None] Created reservations ['b151fd74-44e5-40f8-93b9-2c8c936b3a10', '3d629f2b-0658-4382-94d4-80ad47bbb21f', '6fad9ddf-f98b-4d42-ac89-03f7819a8842', '26e4a23c-66a3-4da1-bce3-37ac7ee803eb'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:31:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-dfe09efc-ed33-4902-9410-c54cc828fc71 tempest-CreateVolumesFromImageTest-415340918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-dfe09efc-ed33-4902-9410-c54cc828fc71 tempest-CreateVolumesFromImageTest-415340918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-dfe09efc-ed33-4902-9410-c54cc828fc71 tempest-CreateVolumesFromImageTest-415340918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-dfe09efc-ed33-4902-9410-c54cc828fc71 tempest-CreateVolumesFromImageTest-415340918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-dfe09efc-ed33-4902-9410-c54cc828fc71 tempest-CreateVolumesFromImageTest-415340918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-dfe09efc-ed33-4902-9410-c54cc828fc71 tempest-CreateVolumesFromImageTest-415340918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:06 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:31:06 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:06 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-68388ce5-6749-4997-9e23-d182c0a23f20 tempest-VolumeDependencyTests-476431000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2.7e258c68-33a7-4846-ba4a-43e47e8f20e3" returned: 0 in 0.736s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:06 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-68388ce5-6749-4997-9e23-d182c0a23f20 tempest-VolumeDependencyTests-476431000 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2.7e258c68-33a7-4846-ba4a-43e47e8f20e3 is being set with open permissions: ugo+rw Jul 10 18:31:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-68388ce5-6749-4997-9e23-d182c0a23f20 tempest-VolumeDependencyTests-476431000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2.7e258c68-33a7-4846-ba4a-43e47e8f20e3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:06 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2.7e258c68-33a7-4846-ba4a-43e47e8f20e3 Jul 10 18:31:06 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:07 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:07 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-dfe09efc-ed33-4902-9410-c54cc828fc71 tempest-CreateVolumesFromImageTest-415340918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.657s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-68388ce5-6749-4997-9e23-d182c0a23f20 tempest-VolumeDependencyTests-476431000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2.7e258c68-33a7-4846-ba4a-43e47e8f20e3" returned: 0 in 0.625s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:07 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-dfe09efc-ed33-4902-9410-c54cc828fc71 tempest-CreateVolumesFromImageTest-415340918 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:31:07 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-dfe09efc-ed33-4902-9410-c54cc828fc71 tempest-CreateVolumesFromImageTest-415340918 None] Deleted volume successfully. Jul 10 18:31:07 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-dfe09efc-ed33-4902-9410-c54cc828fc71 tempest-CreateVolumesFromImageTest-415340918 None] Lock "cinder-e25ab822-0332-40fd-a2c3-6d0c5e8f8f47-delete_volume" released by "delete_volume" :: held 2.329s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-68388ce5-6749-4997-9e23-d182c0a23f20 tempest-VolumeDependencyTests-476431000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:07 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2.info Jul 10 18:31:07 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:07 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-71ebeb36-4a50-4991-b11d-27d9ea1d792c tempest-CreateVolumesFromImageTest-415340918 None] Acquiring lock "cinder-e6b3887d-97fb-43c0-86a6-bc120a7f0f38-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:07 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-71ebeb36-4a50-4991-b11d-27d9ea1d792c tempest-CreateVolumesFromImageTest-415340918 None] Lock "cinder-e6b3887d-97fb-43c0-86a6-bc120a7f0f38-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:07 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-71ebeb36-4a50-4991-b11d-27d9ea1d792c tempest-CreateVolumesFromImageTest-415340918 None] Acquiring lock "cinder-quobyte-e6b3887d-97fb-43c0-86a6-bc120a7f0f38" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:07 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-71ebeb36-4a50-4991-b11d-27d9ea1d792c tempest-CreateVolumesFromImageTest-415340918 None] Lock "cinder-quobyte-e6b3887d-97fb-43c0-86a6-bc120a7f0f38" acquired by "delete_volume" :: waited 0.015s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:07 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed7e860-fda5-4ee2-920a-564cea4708c6]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-71ebeb36-4a50-4991-b11d-27d9ea1d792c tempest-CreateVolumesFromImageTest-415340918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e6b3887d-97fb-43c0-86a6-bc120a7f0f38 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:07 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e6b3887d-97fb-43c0-86a6-bc120a7f0f38 Jul 10 18:31:07 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:07 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-68388ce5-6749-4997-9e23-d182c0a23f20 tempest-VolumeDependencyTests-476431000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2.info" returned: 0 in 0.697s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:07 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-68388ce5-6749-4997-9e23-d182c0a23f20 tempest-VolumeDependencyTests-476431000 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2.info is being set with open permissions: ugo+rw Jul 10 18:31:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-68388ce5-6749-4997-9e23-d182c0a23f20 tempest-VolumeDependencyTests-476431000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:07 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2.info Jul 10 18:31:07 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:08 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-71ebeb36-4a50-4991-b11d-27d9ea1d792c tempest-CreateVolumesFromImageTest-415340918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e6b3887d-97fb-43c0-86a6-bc120a7f0f38" returned: 0 in 0.808s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-71ebeb36-4a50-4991-b11d-27d9ea1d792c tempest-CreateVolumesFromImageTest-415340918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e6b3887d-97fb-43c0-86a6-bc120a7f0f38 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:08 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e6b3887d-97fb-43c0-86a6-bc120a7f0f38 Jul 10 18:31:08 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:08 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-68388ce5-6749-4997-9e23-d182c0a23f20 tempest-VolumeDependencyTests-476431000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2.info" returned: 0 in 0.657s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-68388ce5-6749-4997-9e23-d182c0a23f20 tempest-VolumeDependencyTests-476431000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.421s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5a3b6c20-5168-454f-bd01-2e2dea023c47 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.049s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-5a3b6c20-5168-454f-bd01-2e2dea023c47 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Creating offline snapshot ba50b409-f2c3-4839-b42e-cfcaf9bd5d45 of volume 9720671c-641a-49c2-acb0-a3c502a61d93 {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:31:08 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-68388ce5-6749-4997-9e23-d182c0a23f20 tempest-VolumeDependencyTests-476431000 None] Create snapshot completed successfully Jul 10 18:31:08 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8625cf0-8ccf-45d6-9371-5cf43e7814d7]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5a3b6c20-5168-454f-bd01-2e2dea023c47 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:08 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93 Jul 10 18:31:08 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:08 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-71ebeb36-4a50-4991-b11d-27d9ea1d792c tempest-CreateVolumesFromImageTest-415340918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e6b3887d-97fb-43c0-86a6-bc120a7f0f38" returned: 0 in 0.695s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:08 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-71ebeb36-4a50-4991-b11d-27d9ea1d792c tempest-CreateVolumesFromImageTest-415340918 None] Lock "cinder-quobyte-e6b3887d-97fb-43c0-86a6-bc120a7f0f38" released by "delete_volume" :: held 1.550s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:08 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-71ebeb36-4a50-4991-b11d-27d9ea1d792c tempest-CreateVolumesFromImageTest-415340918 None] Created reservations ['cc242a75-ce60-41e9-accd-bd3d2d039103', '8df41ab4-3d09-43db-a544-6fa20e15ab80', '45b52b3f-7d68-411c-874d-5afb44cd02d1', '07f951d3-4dbd-483c-8c96-ce7948048570'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:31:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-71ebeb36-4a50-4991-b11d-27d9ea1d792c tempest-CreateVolumesFromImageTest-415340918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-71ebeb36-4a50-4991-b11d-27d9ea1d792c tempest-CreateVolumesFromImageTest-415340918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-71ebeb36-4a50-4991-b11d-27d9ea1d792c tempest-CreateVolumesFromImageTest-415340918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-71ebeb36-4a50-4991-b11d-27d9ea1d792c tempest-CreateVolumesFromImageTest-415340918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-71ebeb36-4a50-4991-b11d-27d9ea1d792c tempest-CreateVolumesFromImageTest-415340918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-71ebeb36-4a50-4991-b11d-27d9ea1d792c tempest-CreateVolumesFromImageTest-415340918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:09 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:31:09 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:09 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:31:09 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Flow 'volume_create_manager' (750972c2-cc92-4f27-ac10-c9592ce386f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:31:09 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbda2694-8169-4309-9b2e-e148e54f3fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:09 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5a3b6c20-5168-454f-bd01-2e2dea023c47 tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93" returned: 0 in 0.905s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5a3b6c20-5168-454f-bd01-2e2dea023c47 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93.ba50b409-f2c3-4839-b42e-cfcaf9bd5d45 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:09 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-868bb02a-509b-4ec8-8481-e278529e2b21 tempest-CreateVolumesFromImageTest-415340918 None] Acquiring lock "cinder-e711bbba-5bc6-4e18-96ab-15e2e1891ef3-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:09 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbda2694-8169-4309-9b2e-e148e54f3fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-976941281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db26ad12-1902-4c2e-87e6-105ef710850d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69d420ca51e1454ead8806f4fc6df8cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7e258c68-33a7-4846-ba4a-43e47e8f20e3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:31:09Z,use_quota=True,user_id='07442683970242d0bf37e6202277d131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:09 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a46fc9e-b754-412c-87c1-0ad35abba753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:09 devstack sudo[106108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93.ba50b409-f2c3-4839-b42e-cfcaf9bd5d45 1G Jul 10 18:31:09 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:09 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a46fc9e-b754-412c-87c1-0ad35abba753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:09 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b35777-bf1e-41f7-92b0-ccc185ef9524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:09 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b35777-bf1e-41f7-92b0-ccc185ef9524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'db26ad12-1902-4c2e-87e6-105ef710850d', 'volume_name': 'volume-db26ad12-1902-4c2e-87e6-105ef710850d', 'volume_size': 1, 'snapshot_id': '7e258c68-33a7-4846-ba4a-43e47e8f20e3'}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:09 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38e4272a-fed6-4f2a-8f3c-d94eabef919a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:09 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38e4272a-fed6-4f2a-8f3c-d94eabef919a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:09 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce0877d8-b1cb-49df-bdec-1a307066235d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:09 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Volume db26ad12-1902-4c2e-87e6-105ef710850d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-db26ad12-1902-4c2e-87e6-105ef710850d', 'volume_size': 1, 'snapshot_id': '7e258c68-33a7-4846-ba4a-43e47e8f20e3'} Jul 10 18:31:09 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-868bb02a-509b-4ec8-8481-e278529e2b21 tempest-CreateVolumesFromImageTest-415340918 None] Lock "cinder-e711bbba-5bc6-4e18-96ab-15e2e1891ef3-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:09 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-868bb02a-509b-4ec8-8481-e278529e2b21 tempest-CreateVolumesFromImageTest-415340918 None] Acquiring lock "cinder-quobyte-e711bbba-5bc6-4e18-96ab-15e2e1891ef3" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:09 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-868bb02a-509b-4ec8-8481-e278529e2b21 tempest-CreateVolumesFromImageTest-415340918 None] Lock "cinder-quobyte-e711bbba-5bc6-4e18-96ab-15e2e1891ef3" acquired by "delete_volume" :: waited 0.015s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:09 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2f212b-6cf1-4394-9918-08cfa643b16d]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-868bb02a-509b-4ec8-8481-e278529e2b21 tempest-CreateVolumesFromImageTest-415340918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e711bbba-5bc6-4e18-96ab-15e2e1891ef3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:09 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-71ebeb36-4a50-4991-b11d-27d9ea1d792c tempest-CreateVolumesFromImageTest-415340918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.728s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:09 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-71ebeb36-4a50-4991-b11d-27d9ea1d792c tempest-CreateVolumesFromImageTest-415340918 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:31:09 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-71ebeb36-4a50-4991-b11d-27d9ea1d792c tempest-CreateVolumesFromImageTest-415340918 None] Deleted volume successfully. Jul 10 18:31:09 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-71ebeb36-4a50-4991-b11d-27d9ea1d792c tempest-CreateVolumesFromImageTest-415340918 None] Lock "cinder-e6b3887d-97fb-43c0-86a6-bc120a7f0f38-delete_volume" released by "delete_volume" :: held 2.504s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:09 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e711bbba-5bc6-4e18-96ab-15e2e1891ef3 Jul 10 18:31:09 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:10 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5a3b6c20-5168-454f-bd01-2e2dea023c47 tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93.ba50b409-f2c3-4839-b42e-cfcaf9bd5d45 1G" returned: 0 in 0.922s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5a3b6c20-5168-454f-bd01-2e2dea023c47 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9720671c-641a-49c2-acb0-a3c502a61d93 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93.ba50b409-f2c3-4839-b42e-cfcaf9bd5d45 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:10 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9720671c-641a-49c2-acb0-a3c502a61d93 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93.ba50b409-f2c3-4839-b42e-cfcaf9bd5d45 Jul 10 18:31:10 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:10 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-868bb02a-509b-4ec8-8481-e278529e2b21 tempest-CreateVolumesFromImageTest-415340918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e711bbba-5bc6-4e18-96ab-15e2e1891ef3" returned: 0 in 0.792s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-868bb02a-509b-4ec8-8481-e278529e2b21 tempest-CreateVolumesFromImageTest-415340918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e711bbba-5bc6-4e18-96ab-15e2e1891ef3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:10 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e711bbba-5bc6-4e18-96ab-15e2e1891ef3 Jul 10 18:31:10 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:11 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-868bb02a-509b-4ec8-8481-e278529e2b21 tempest-CreateVolumesFromImageTest-415340918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-e711bbba-5bc6-4e18-96ab-15e2e1891ef3" returned: 0 in 0.649s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:11 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5a3b6c20-5168-454f-bd01-2e2dea023c47 tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9720671c-641a-49c2-acb0-a3c502a61d93 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93.ba50b409-f2c3-4839-b42e-cfcaf9bd5d45" returned: 0 in 0.711s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:11 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-5a3b6c20-5168-454f-bd01-2e2dea023c47 tempest-CreateVolumesFromSnapshotTest-2132304058 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93.ba50b409-f2c3-4839-b42e-cfcaf9bd5d45 is being set with open permissions: ugo+rw Jul 10 18:31:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5a3b6c20-5168-454f-bd01-2e2dea023c47 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93.ba50b409-f2c3-4839-b42e-cfcaf9bd5d45 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:11 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-868bb02a-509b-4ec8-8481-e278529e2b21 tempest-CreateVolumesFromImageTest-415340918 None] Lock "cinder-quobyte-e711bbba-5bc6-4e18-96ab-15e2e1891ef3" released by "delete_volume" :: held 1.487s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:11 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93.ba50b409-f2c3-4839-b42e-cfcaf9bd5d45 Jul 10 18:31:11 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:11 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-868bb02a-509b-4ec8-8481-e278529e2b21 tempest-CreateVolumesFromImageTest-415340918 None] Created reservations ['a0aee159-326d-48c1-b215-63d53629bd33', '6398032d-dd75-482a-9e3e-7b04f1eb318a', '01148edd-de6d-4fd0-a46e-77490cb41945', 'fa8e0daa-bfd8-4e64-8ab0-f1cb8ab333af'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:31:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-868bb02a-509b-4ec8-8481-e278529e2b21 tempest-CreateVolumesFromImageTest-415340918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-868bb02a-509b-4ec8-8481-e278529e2b21 tempest-CreateVolumesFromImageTest-415340918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:11 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-868bb02a-509b-4ec8-8481-e278529e2b21 tempest-CreateVolumesFromImageTest-415340918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:11 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-868bb02a-509b-4ec8-8481-e278529e2b21 tempest-CreateVolumesFromImageTest-415340918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-868bb02a-509b-4ec8-8481-e278529e2b21 tempest-CreateVolumesFromImageTest-415340918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-868bb02a-509b-4ec8-8481-e278529e2b21 tempest-CreateVolumesFromImageTest-415340918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:11 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:31:11 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:11 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b7dc9185-15b8-42e1-85cc-028455c70f4e tempest-CreateVolumesFromImageTest-415340918 None] Acquiring lock "cinder-ac6cc643-f077-415a-ae30-c3b676ba7d3c-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:11 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:11 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b7dc9185-15b8-42e1-85cc-028455c70f4e tempest-CreateVolumesFromImageTest-415340918 None] Lock "cinder-ac6cc643-f077-415a-ae30-c3b676ba7d3c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5a3b6c20-5168-454f-bd01-2e2dea023c47 tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93.ba50b409-f2c3-4839-b42e-cfcaf9bd5d45" returned: 0 in 0.692s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5a3b6c20-5168-454f-bd01-2e2dea023c47 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:11 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b7dc9185-15b8-42e1-85cc-028455c70f4e tempest-CreateVolumesFromImageTest-415340918 None] Acquiring lock "cinder-quobyte-ac6cc643-f077-415a-ae30-c3b676ba7d3c" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:11 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93.info Jul 10 18:31:11 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:11 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b7dc9185-15b8-42e1-85cc-028455c70f4e tempest-CreateVolumesFromImageTest-415340918 None] Lock "cinder-quobyte-ac6cc643-f077-415a-ae30-c3b676ba7d3c" acquired by "delete_volume" :: waited 0.021s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:11 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-868bb02a-509b-4ec8-8481-e278529e2b21 tempest-CreateVolumesFromImageTest-415340918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.676s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:11 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-868bb02a-509b-4ec8-8481-e278529e2b21 tempest-CreateVolumesFromImageTest-415340918 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:31:11 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8934586-02a6-4af3-8af2-014cb59bf900]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b7dc9185-15b8-42e1-85cc-028455c70f4e tempest-CreateVolumesFromImageTest-415340918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ac6cc643-f077-415a-ae30-c3b676ba7d3c {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:11 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-868bb02a-509b-4ec8-8481-e278529e2b21 tempest-CreateVolumesFromImageTest-415340918 None] Deleted volume successfully. Jul 10 18:31:11 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-868bb02a-509b-4ec8-8481-e278529e2b21 tempest-CreateVolumesFromImageTest-415340918 None] Lock "cinder-e711bbba-5bc6-4e18-96ab-15e2e1891ef3-delete_volume" released by "delete_volume" :: held 2.376s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:12 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ac6cc643-f077-415a-ae30-c3b676ba7d3c Jul 10 18:31:12 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:12 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5a3b6c20-5168-454f-bd01-2e2dea023c47 tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93.info" returned: 0 in 0.689s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:12 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-5a3b6c20-5168-454f-bd01-2e2dea023c47 tempest-CreateVolumesFromSnapshotTest-2132304058 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93.info is being set with open permissions: ugo+rw Jul 10 18:31:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5a3b6c20-5168-454f-bd01-2e2dea023c47 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:12 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93.info Jul 10 18:31:12 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:12 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b7dc9185-15b8-42e1-85cc-028455c70f4e tempest-CreateVolumesFromImageTest-415340918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ac6cc643-f077-415a-ae30-c3b676ba7d3c" returned: 0 in 0.737s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b7dc9185-15b8-42e1-85cc-028455c70f4e tempest-CreateVolumesFromImageTest-415340918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ac6cc643-f077-415a-ae30-c3b676ba7d3c {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:12 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ac6cc643-f077-415a-ae30-c3b676ba7d3c Jul 10 18:31:12 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:13 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5a3b6c20-5168-454f-bd01-2e2dea023c47 tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93.info" returned: 0 in 0.658s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5a3b6c20-5168-454f-bd01-2e2dea023c47 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.679s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.541s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:13 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c259f7e4-c3dc-4741-af8b-5bb2d15b5056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca8519c67d14a049008a764de4ea95f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:30:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:30:57Z,use_quota=True,user_id='9ec2bfc9497e4278abc9fd0b1b5ad2e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb5556f5-5c74-4ccf-b381-01b02da8a38c),volume_type_id=fb5556f5-5c74-4ccf-b381-01b02da8a38c)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:31:13 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Creating volume c259f7e4-c3dc-4741-af8b-5bb2d15b5056 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:31:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:13 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:13 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:13 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:31:13 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:31:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:13 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056 1073741824 Jul 10 18:31:13 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:13 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-5a3b6c20-5168-454f-bd01-2e2dea023c47 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Create snapshot completed successfully Jul 10 18:31:13 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b7dc9185-15b8-42e1-85cc-028455c70f4e tempest-CreateVolumesFromImageTest-415340918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-ac6cc643-f077-415a-ae30-c3b676ba7d3c" returned: 0 in 0.665s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:13 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b7dc9185-15b8-42e1-85cc-028455c70f4e tempest-CreateVolumesFromImageTest-415340918 None] Lock "cinder-quobyte-ac6cc643-f077-415a-ae30-c3b676ba7d3c" released by "delete_volume" :: held 1.449s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:13 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-b7dc9185-15b8-42e1-85cc-028455c70f4e tempest-CreateVolumesFromImageTest-415340918 None] Created reservations ['f4fb5a62-49ba-42a4-af36-c4f9317743fb', 'fe2ed83a-34b3-464d-af58-30cc5c66efc2', 'c2ec1785-f4ff-4283-837a-3ae14464ee15', 'dddcb4a4-80c6-4ea5-8666-eb960a771b3c'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:31:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b7dc9185-15b8-42e1-85cc-028455c70f4e tempest-CreateVolumesFromImageTest-415340918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b7dc9185-15b8-42e1-85cc-028455c70f4e tempest-CreateVolumesFromImageTest-415340918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:13 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b7dc9185-15b8-42e1-85cc-028455c70f4e tempest-CreateVolumesFromImageTest-415340918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:13 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b7dc9185-15b8-42e1-85cc-028455c70f4e tempest-CreateVolumesFromImageTest-415340918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b7dc9185-15b8-42e1-85cc-028455c70f4e tempest-CreateVolumesFromImageTest-415340918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b7dc9185-15b8-42e1-85cc-028455c70f4e tempest-CreateVolumesFromImageTest-415340918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:13 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:31:13 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:14 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-62b94511-3d3c-43d2-be99-e1dfccf9ef88 tempest-CreateVolumesFromImageTest-415340918 None] Acquiring lock "cinder-f04eb46e-3fb5-4f3e-8c91-f64625eb2c81-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:14 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-62b94511-3d3c-43d2-be99-e1dfccf9ef88 tempest-CreateVolumesFromImageTest-415340918 None] Lock "cinder-f04eb46e-3fb5-4f3e-8c91-f64625eb2c81-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:14 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-62b94511-3d3c-43d2-be99-e1dfccf9ef88 tempest-CreateVolumesFromImageTest-415340918 None] Acquiring lock "cinder-quobyte-f04eb46e-3fb5-4f3e-8c91-f64625eb2c81" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:14 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-62b94511-3d3c-43d2-be99-e1dfccf9ef88 tempest-CreateVolumesFromImageTest-415340918 None] Lock "cinder-quobyte-f04eb46e-3fb5-4f3e-8c91-f64625eb2c81" acquired by "delete_volume" :: waited 0.028s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:14 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b7dc9185-15b8-42e1-85cc-028455c70f4e tempest-CreateVolumesFromImageTest-415340918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.705s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:14 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-b7dc9185-15b8-42e1-85cc-028455c70f4e tempest-CreateVolumesFromImageTest-415340918 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:31:14 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-b7dc9185-15b8-42e1-85cc-028455c70f4e tempest-CreateVolumesFromImageTest-415340918 None] Deleted volume successfully. Jul 10 18:31:14 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[79eb7536-3869-4b4f-a362-5870d8954bda]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-62b94511-3d3c-43d2-be99-e1dfccf9ef88 tempest-CreateVolumesFromImageTest-415340918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f04eb46e-3fb5-4f3e-8c91-f64625eb2c81 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:14 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056 1073741824" returned: 0 in 0.970s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:14 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b7dc9185-15b8-42e1-85cc-028455c70f4e tempest-CreateVolumesFromImageTest-415340918 None] Lock "cinder-ac6cc643-f077-415a-ae30-c3b676ba7d3c-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:14 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056 Jul 10 18:31:14 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:14 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f04eb46e-3fb5-4f3e-8c91-f64625eb2c81 Jul 10 18:31:14 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:14 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:31:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Flow 'volume_create_manager' (2acf209a-b10d-40fc-9a5d-4099c8251c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:31:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8bdc916-2ff7-48d3-9ec6-3d18c91cfa07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8bdc916-2ff7-48d3-9ec6-3d18c91cfa07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-77017148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d7817cd-462f-4abb-9f9c-80107a2a565d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbbefa2e79fa45f6893e5f1ed789a47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:31:15Z,use_quota=True,user_id='611adf05624a48d1b579cfbdb2c41f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aed3760-33da-4e73-9049-72828a1ffcb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aed3760-33da-4e73-9049-72828a1ffcb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9c4117e-f99a-4d66-8935-5f4ca8d84308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9c4117e-f99a-4d66-8935-5f4ca8d84308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d7817cd-462f-4abb-9f9c-80107a2a565d', 'volume_name': 'volume-1d7817cd-462f-4abb-9f9c-80107a2a565d', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (918b4a62-3c93-4b88-b196-34868781930c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (918b4a62-3c93-4b88-b196-34868781930c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf93a82-9bc4-407b-82ad-c7f0b5f1ca12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:14 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Volume 1d7817cd-462f-4abb-9f9c-80107a2a565d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d7817cd-462f-4abb-9f9c-80107a2a565d', 'volume_size': 1} Jul 10 18:31:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Flow 'volume_create_manager' (25a50fbd-9baa-485f-adec-10749b7e8016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e00baee-8873-4f83-9fa7-26d533655988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:15 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e00baee-8873-4f83-9fa7-26d533655988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-248959330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d414483-8922-49c3-883b-6381e8ef4e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbbefa2e79fa45f6893e5f1ed789a47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:31:15Z,use_quota=True,user_id='611adf05624a48d1b579cfbdb2c41f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7239a3e-cd29-45ec-ac6c-534f027ee343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7239a3e-cd29-45ec-ac6c-534f027ee343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b40019c4-6d30-40ee-8ee9-50026bdcf51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b40019c4-6d30-40ee-8ee9-50026bdcf51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d414483-8922-49c3-883b-6381e8ef4e11', 'volume_name': 'volume-3d414483-8922-49c3-883b-6381e8ef4e11', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf4577c5-ae2a-4c1a-a021-af8df2973f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:15 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf4577c5-ae2a-4c1a-a021-af8df2973f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5389a76c-4e03-4d87-9ce9-8633efa6317c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:15 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Volume 3d414483-8922-49c3-883b-6381e8ef4e11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d414483-8922-49c3-883b-6381e8ef4e11', 'volume_size': 1} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056" returned: 0 in 0.866s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-62b94511-3d3c-43d2-be99-e1dfccf9ef88 tempest-CreateVolumesFromImageTest-415340918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f04eb46e-3fb5-4f3e-8c91-f64625eb2c81" returned: 0 in 0.927s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.893s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-62b94511-3d3c-43d2-be99-e1dfccf9ef88 tempest-CreateVolumesFromImageTest-415340918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f04eb46e-3fb5-4f3e-8c91-f64625eb2c81 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.535s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Acquiring lock "cinder-quobyte-7e258c68-33a7-4846-ba4a-43e47e8f20e3-db26ad12-1902-4c2e-87e6-105ef710850d" by "_create_volume_from_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:15 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f04eb46e-3fb5-4f3e-8c91-f64625eb2c81 Jul 10 18:31:15 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.volume.volume_utils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Attempting download of a382e9ed-ee84-4515-9e0a-8eb8922a72ce ((None, [{'url': 'file:///opt/stack/data/glance/images/a382e9ed-ee84-4515-9e0a-8eb8922a72ce', 'metadata': {}}])) to volume c259f7e4-c3dc-4741-af8b-5bb2d15b5056. {{(pid=87399) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Lock "cinder-quobyte-7e258c68-33a7-4846-ba4a-43e47e8f20e3-db26ad12-1902-4c2e-87e6-105ef710850d" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Creating volume db26ad12-1902-4c2e-87e6-105ef710850d from snapshot 7e258c68-33a7-4846-ba4a-43e47e8f20e3 {{(pid=87399) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Acquiring lock "cinder-quobyte-db26ad12-1902-4c2e-87e6-105ef710850d" by "_copy_volume_from_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Lock "cinder-quobyte-db26ad12-1902-4c2e-87e6-105ef710850d" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] snapshot: 7e258c68-33a7-4846-ba4a-43e47e8f20e3, volume: db26ad12-1902-4c2e-87e6-105ef710850d, {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b21f19c-5e90-4457-b034-8f0ba30c8d54]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a382e9ed-ee84-4515-9e0a-8eb8922a72ce_4xhmn6th {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e0c47c-726f-4b92-ac44-303d2974d6e9]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2.7e258c68-33a7-4846-ba4a-43e47e8f20e3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:15 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a382e9ed-ee84-4515-9e0a-8eb8922a72ce_4xhmn6th Jul 10 18:31:15 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:15 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2.7e258c68-33a7-4846-ba4a-43e47e8f20e3 Jul 10 18:31:15 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Flow 'volume_create_manager' (58489aed-a561-45c3-9ae0-6ffa119d983e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f8674c5-0263-41ad-8c48-2b1b7843350b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f8674c5-0263-41ad-8c48-2b1b7843350b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-18977539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a81e60be-4649-458c-b674-48c61ca234e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbbefa2e79fa45f6893e5f1ed789a47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:31:15Z,use_quota=True,user_id='611adf05624a48d1b579cfbdb2c41f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22070dd4-a6ff-4f38-b858-1e94e1d9fdff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22070dd4-a6ff-4f38-b858-1e94e1d9fdff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4963f259-32e5-403b-9680-9bd755769fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4963f259-32e5-403b-9680-9bd755769fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a81e60be-4649-458c-b674-48c61ca234e4', 'volume_name': 'volume-a81e60be-4649-458c-b674-48c61ca234e4', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d20219-2f4c-4d63-9ed8-0c211b31edd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23d20219-2f4c-4d63-9ed8-0c211b31edd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e0d388-155f-49e7-b4f3-04ede036dd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:15 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Volume a81e60be-4649-458c-b674-48c61ca234e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a81e60be-4649-458c-b674-48c61ca234e4', 'volume_size': 1} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:15 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:31:15 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Flow 'volume_create_manager' (fb868095-615c-4461-8296-8b05114d9abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202b222c-e6ea-4169-9af3-30ec16e457f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-62b94511-3d3c-43d2-be99-e1dfccf9ef88 tempest-CreateVolumesFromImageTest-415340918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f04eb46e-3fb5-4f3e-8c91-f64625eb2c81" returned: 0 in 0.887s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (202b222c-e6ea-4169-9af3-30ec16e457f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1906187043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=379df739-3baf-425e-bbb4-e2abc1d72145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbbefa2e79fa45f6893e5f1ed789a47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:31:16Z,use_quota=True,user_id='611adf05624a48d1b579cfbdb2c41f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed396051-eba4-4466-8082-8cabe7c199a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed396051-eba4-4466-8082-8cabe7c199a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8efe4c38-f08a-47ce-b92f-4d5f021e03cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8efe4c38-f08a-47ce-b92f-4d5f021e03cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '379df739-3baf-425e-bbb4-e2abc1d72145', 'volume_name': 'volume-379df739-3baf-425e-bbb4-e2abc1d72145', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4afb7eb-9b1b-4a7b-a65f-84e61248b945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4afb7eb-9b1b-4a7b-a65f-84e61248b945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db42068-0e2e-4f81-b624-b4c3e3b9e17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:16 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Volume 379df739-3baf-425e-bbb4-e2abc1d72145: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-379df739-3baf-425e-bbb4-e2abc1d72145', 'volume_size': 1} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-62b94511-3d3c-43d2-be99-e1dfccf9ef88 tempest-CreateVolumesFromImageTest-415340918 None] Lock "cinder-quobyte-f04eb46e-3fb5-4f3e-8c91-f64625eb2c81" released by "delete_volume" :: held 2.005s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-62b94511-3d3c-43d2-be99-e1dfccf9ef88 tempest-CreateVolumesFromImageTest-415340918 None] Created reservations ['077cd4b6-3095-4d68-9106-fb698ec90006', '34ed4ee6-6ba0-4284-80ac-83d524a46082', 'e6831db0-501a-4e47-bc6a-df2a3c4f9db5', '84668f14-5c2e-4e52-b38e-8b9bd9e46c68'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-62b94511-3d3c-43d2-be99-e1dfccf9ef88 tempest-CreateVolumesFromImageTest-415340918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-62b94511-3d3c-43d2-be99-e1dfccf9ef88 tempest-CreateVolumesFromImageTest-415340918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-62b94511-3d3c-43d2-be99-e1dfccf9ef88 tempest-CreateVolumesFromImageTest-415340918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-62b94511-3d3c-43d2-be99-e1dfccf9ef88 tempest-CreateVolumesFromImageTest-415340918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-62b94511-3d3c-43d2-be99-e1dfccf9ef88 tempest-CreateVolumesFromImageTest-415340918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-62b94511-3d3c-43d2-be99-e1dfccf9ef88 tempest-CreateVolumesFromImageTest-415340918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:16 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:31:16 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:16 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2.7e258c68-33a7-4846-ba4a-43e47e8f20e3" returned: 0 in 1.171s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] will copy from snapshot at /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2 {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Creating direct copy from snapshot {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5cb93e-b0aa-492c-919a-0264a374530b]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:31:16 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] Flow 'volume_create_manager' (8eb276e5-7440-4bda-8b24-e283e10d2711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16371a72-a7a4-4ba1-9a32-79a887454442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a382e9ed-ee84-4515-9e0a-8eb8922a72ce_4xhmn6th" returned: 0 in 1.330s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a382e9ed-ee84-4515-9e0a-8eb8922a72ce_4xhmn6th {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16371a72-a7a4-4ba1-9a32-79a887454442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-877828397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc52dfbb-6b01-42cc-848e-0d7c00b353f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbbefa2e79fa45f6893e5f1ed789a47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:31:16Z,use_quota=True,user_id='611adf05624a48d1b579cfbdb2c41f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d5c8609-d197-45c2-b570-f9f614e7b459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d5c8609-d197-45c2-b570-f9f614e7b459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c9041e6-6140-484f-81ba-c783d9a61540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c9041e6-6140-484f-81ba-c783d9a61540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc52dfbb-6b01-42cc-848e-0d7c00b353f6', 'volume_name': 'volume-fc52dfbb-6b01-42cc-848e-0d7c00b353f6', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27eba12f-c463-4d30-97ae-501de8005385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27eba12f-c463-4d30-97ae-501de8005385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (351eb598-1ff0-42e4-9ce3-0f5bcd4f1f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:16 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] Volume fc52dfbb-6b01-42cc-848e-0d7c00b353f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc52dfbb-6b01-42cc-848e-0d7c00b353f6', 'volume_size': 1} Jul 10 18:31:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:16 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2 Jul 10 18:31:16 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:16 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a382e9ed-ee84-4515-9e0a-8eb8922a72ce_4xhmn6th Jul 10 18:31:16 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:17 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-62b94511-3d3c-43d2-be99-e1dfccf9ef88 tempest-CreateVolumesFromImageTest-415340918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.750s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:17 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-62b94511-3d3c-43d2-be99-e1dfccf9ef88 tempest-CreateVolumesFromImageTest-415340918 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:31:17 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-62b94511-3d3c-43d2-be99-e1dfccf9ef88 tempest-CreateVolumesFromImageTest-415340918 None] Deleted volume successfully. Jul 10 18:31:17 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-62b94511-3d3c-43d2-be99-e1dfccf9ef88 tempest-CreateVolumesFromImageTest-415340918 None] Lock "cinder-f04eb46e-3fb5-4f3e-8c91-f64625eb2c81-delete_volume" released by "delete_volume" :: held 3.032s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:17 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a382e9ed-ee84-4515-9e0a-8eb8922a72ce_4xhmn6th" returned: 1 in 0.902s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a382e9ed-ee84-4515-9e0a-8eb8922a72ce_4xhmn6th' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:31:17 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b68426b-c906-4410-aa15-104d6bb11c9f]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a382e9ed-ee84-4515-9e0a-8eb8922a72ce_wwh2mmj0devstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:17 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2" returned: 0 in 1.017s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:17 devstack cinder-volume[87399]: DEBUG cinder.utils [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Path /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db26ad12-1902-4c2e-87e6-105ef710850d not found in is_blk_device check {{(pid=87399) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 18:31:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db26ad12-1902-4c2e-87e6-105ef710850d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:17 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db26ad12-1902-4c2e-87e6-105ef710850d Jul 10 18:31:17 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:17 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a382e9ed-ee84-4515-9e0a-8eb8922a72ce_wwh2mmj0devstack@QuobyteHD Jul 10 18:31:17 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:18 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a382e9ed-ee84-4515-9e0a-8eb8922a72ce_wwh2mmj0devstack@QuobyteHD" returned: 0 in 0.849s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a382e9ed-ee84-4515-9e0a-8eb8922a72ce_wwh2mmj0devstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:18 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a382e9ed-ee84-4515-9e0a-8eb8922a72ce_wwh2mmj0devstack@QuobyteHD Jul 10 18:31:18 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:20 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a382e9ed-ee84-4515-9e0a-8eb8922a72ce_wwh2mmj0devstack@QuobyteHD" returned: 1 in 2.121s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a382e9ed-ee84-4515-9e0a-8eb8922a72ce_wwh2mmj0devstack@QuobyteHD' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:31:20 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] a382e9ed-ee84-4515-9e0a-8eb8922a72ce was raw, converting to raw {{(pid=87399) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 18:31:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a382e9ed-ee84-4515-9e0a-8eb8922a72ce_wwh2mmj0devstack@QuobyteHD /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:20 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a382e9ed-ee84-4515-9e0a-8eb8922a72ce_wwh2mmj0devstack@QuobyteHD /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056 Jul 10 18:31:20 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:21 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:31:21 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Flow 'volume_create_manager' (f4f4a49d-881a-4f8e-b8ca-05aeb65e7e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:31:21 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c77ebdc6-c52d-4ff9-a603-9d6c96742621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:21 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c77ebdc6-c52d-4ff9-a603-9d6c96742621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-143827185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d1e6829-9cf0-499a-bf9e-ed94727d3ae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bdebbc27cc745e1a7d011316ca44ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:31:21Z,use_quota=True,user_id='a71ea1188e134470bdec99d18107bd26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:21 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a96cdd96-4b16-4d6f-8507-cab70ffc5ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:21 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a96cdd96-4b16-4d6f-8507-cab70ffc5ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:21 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c8d32d-47e9-48d5-9bd4-836d09a7e0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:21 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c8d32d-47e9-48d5-9bd4-836d09a7e0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d1e6829-9cf0-499a-bf9e-ed94727d3ae2', 'volume_name': 'volume-1d1e6829-9cf0-499a-bf9e-ed94727d3ae2', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:21 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a29de3b4-2032-43a6-8f41-e897a1b273a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:21 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a29de3b4-2032-43a6-8f41-e897a1b273a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:21 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d162e0b0-ab16-45eb-a4af-5c2313b7f087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:21 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Volume 1d1e6829-9cf0-499a-bf9e-ed94727d3ae2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d1e6829-9cf0-499a-bf9e-ed94727d3ae2', 'volume_size': 1} Jul 10 18:31:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:22 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a382e9ed-ee84-4515-9e0a-8eb8922a72ce_wwh2mmj0devstack@QuobyteHD /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056" returned: 0 in 1.699s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:22 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a382e9ed-ee84-4515-9e0a-8eb8922a72ce_wwh2mmj0devstack@QuobyteHD, size 0.00 MB, duration 1.70 sec, destination /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056 {{(pid=87399) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 18:31:22 devstack cinder-volume[87399]: INFO cinder.image.image_utils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 18:31:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:22 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056 1G Jul 10 18:31:22 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:23 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db26ad12-1902-4c2e-87e6-105ef710850d" returned: 0 in 5.694s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:23 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[8184159b-ba46-449f-ab9e-2dc07e459911]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:23 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056 1G" returned: 0 in 1.110s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:23 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[b138ab45-92e0-442f-8320-a6e78ba3ebc3]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:23 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2 Jul 10 18:31:23 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:23 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056 Jul 10 18:31:23 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:24 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056" returned: 0 in 0.758s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:24 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2" returned: 0 in 0.920s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:24 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Image conversion details: src /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2, size 1024.00 MB, duration 5.70 sec, destination /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db26ad12-1902-4c2e-87e6-105ef710850d {{(pid=87399) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 18:31:24 devstack cinder-volume[87399]: INFO cinder.image.image_utils [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Converted 1024.00 MB image at 179.80 MB/s Jul 10 18:31:24 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db26ad12-1902-4c2e-87e6-105ef710850d is being set with open permissions: ugo+rw Jul 10 18:31:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db26ad12-1902-4c2e-87e6-105ef710850d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:24 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056 Jul 10 18:31:24 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:24 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db26ad12-1902-4c2e-87e6-105ef710850d Jul 10 18:31:24 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:24 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db26ad12-1902-4c2e-87e6-105ef710850d" returned: 0 in 0.650s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:24 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Lock "cinder-quobyte-db26ad12-1902-4c2e-87e6-105ef710850d" released by "_copy_volume_from_snapshot" :: held 9.598s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:24 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:24 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Lock "cinder-quobyte-7e258c68-33a7-4846-ba4a-43e47e8f20e3-db26ad12-1902-4c2e-87e6-105ef710850d" released by "_create_volume_from_snapshot" :: held 9.661s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.702s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.029s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-77017148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d7817cd-462f-4abb-9f9c-80107a2a565d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbbefa2e79fa45f6893e5f1ed789a47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:31:15Z,use_quota=True,user_id='611adf05624a48d1b579cfbdb2c41f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:31:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Creating volume 1d7817cd-462f-4abb-9f9c-80107a2a565d {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:31:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:31:24 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:31:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1d7817cd-462f-4abb-9f9c-80107a2a565d 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056" returned: 1 in 0.791s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:31:24 devstack cinder-volume[87399]: DEBUG cinder.volume.volume_utils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Downloaded image a382e9ed-ee84-4515-9e0a-8eb8922a72ce ((None, [{'url': 'file:///opt/stack/data/glance/images/a382e9ed-ee84-4515-9e0a-8eb8922a72ce', 'metadata': {}}])) to volume c259f7e4-c3dc-4741-af8b-5bb2d15b5056 successfully. {{(pid=87399) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 18:31:24 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Temporary image a382e9ed-ee84-4515-9e0a-8eb8922a72ce for user 9ec2bfc9497e4278abc9fd0b1b5ad2e5 is deleted. {{(pid=87399) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 18:31:24 devstack cinder-volume[87399]: DEBUG cinder.volume.volume_utils [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Marking volume c259f7e4-c3dc-4741-af8b-5bb2d15b5056 as bootable. {{(pid=87399) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 18:31:24 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1d7817cd-462f-4abb-9f9c-80107a2a565d 1073741824 Jul 10 18:31:24 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:24 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Copying metadata from image a382e9ed-ee84-4515-9e0a-8eb8922a72ce to c259f7e4-c3dc-4741-af8b-5bb2d15b5056. {{(pid=87399) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 18:31:24 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Creating volume glance metadata for volume c259f7e4-c3dc-4741-af8b-5bb2d15b5056 backed by image a382e9ed-ee84-4515-9e0a-8eb8922a72ce with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a382e9ed-ee84-4515-9e0a-8eb8922a72ce', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'f81a8ff11fec90b6e5041b0ac9c7483c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87399) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 18:31:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce0877d8-b1cb-49df-bdec-1a307066235d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db26ad12-1902-4c2e-87e6-105ef710850d', 'volume_size': 1, 'snapshot_id': '7e258c68-33a7-4846-ba4a-43e47e8f20e3'}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4ec3bfb-aeae-49b6-a562-646c5d06a104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:24 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Volume volume-db26ad12-1902-4c2e-87e6-105ef710850d (db26ad12-1902-4c2e-87e6-105ef710850d): created successfully Jul 10 18:31:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4ec3bfb-aeae-49b6-a562-646c5d06a104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:24 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Flow 'volume_create_manager' (750972c2-cc92-4f27-ac10-c9592ce386f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:31:24 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-1de5e730-e9b7-4171-968d-63cbf106083b tempest-VolumeDependencyTests-476431000 None] Created volume successfully. Jul 10 18:31:25 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4310ee35-7ae5-4055-b447-74decc5d602f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056', 'volume_size': 1, 'image_id': 'a382e9ed-ee84-4515-9e0a-8eb8922a72ce', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a382e9ed-ee84-4515-9e0a-8eb8922a72ce', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f81a8ff11fec90b6e5041b0ac9c7483c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9ca8519c67d14a049008a764de4ea95f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b789dd6324b0a6b7b14ac7ea9ccb4b559aee1f85f892a87cb39330101e527c2743de3e75a8244dc286098162d4df0c73d2fbf272e59a0af5fa8dadf41773f346', 'id': 'a382e9ed-ee84-4515-9e0a-8eb8922a72ce', 'created_at': datetime.datetime(2026, 7, 10, 16, 30, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 16, 30, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a382e9ed-ee84-4515-9e0a-8eb8922a72ce/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:25 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac7c0ad-02a4-4a19-8161-326ec13c168b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:25 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Volume volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056 (c259f7e4-c3dc-4741-af8b-5bb2d15b5056): created successfully Jul 10 18:31:25 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac7c0ad-02a4-4a19-8161-326ec13c168b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:25 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Flow 'volume_create_manager' (1becbf4d-ec7c-40c2-8ce0-bb310456a83f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:31:25 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-97d5c550-7930-43c6-b102-7633671893df tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Created volume successfully. Jul 10 18:31:25 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1d7817cd-462f-4abb-9f9c-80107a2a565d 1073741824" returned: 0 in 0.808s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1d7817cd-462f-4abb-9f9c-80107a2a565d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:25 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1d7817cd-462f-4abb-9f9c-80107a2a565d Jul 10 18:31:25 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:25 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e654b901-40e7-4407-b149-7613d5622dd2 tempest-VolumeDependencyTests-476431000 None] Acquiring lock "cinder-7e258c68-33a7-4846-ba4a-43e47e8f20e3-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:25 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e654b901-40e7-4407-b149-7613d5622dd2 tempest-VolumeDependencyTests-476431000 None] Lock "cinder-7e258c68-33a7-4846-ba4a-43e47e8f20e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:25 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e654b901-40e7-4407-b149-7613d5622dd2 tempest-VolumeDependencyTests-476431000 None] Acquiring lock "cinder-quobyte-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:25 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e654b901-40e7-4407-b149-7613d5622dd2 tempest-VolumeDependencyTests-476431000 None] Lock "cinder-quobyte-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:25 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e654b901-40e7-4407-b149-7613d5622dd2 tempest-VolumeDependencyTests-476431000 None] Acquiring lock "cinder-quobyte-7e258c68-33a7-4846-ba4a-43e47e8f20e3" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:25 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e654b901-40e7-4407-b149-7613d5622dd2 tempest-VolumeDependencyTests-476431000 None] Lock "cinder-quobyte-7e258c68-33a7-4846-ba4a-43e47e8f20e3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:25 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-e654b901-40e7-4407-b149-7613d5622dd2 tempest-VolumeDependencyTests-476431000 None] Deleting offline snapshot 7e258c68-33a7-4846-ba4a-43e47e8f20e3 of volume 42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:31:26 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-e654b901-40e7-4407-b149-7613d5622dd2 tempest-VolumeDependencyTests-476431000 None] snapshot_file for this snap is: volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2.7e258c68-33a7-4846-ba4a-43e47e8f20e3 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:31:26 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca928ec8-0189-4fb4-9933-edb7fb658b32]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e654b901-40e7-4407-b149-7613d5622dd2 tempest-VolumeDependencyTests-476431000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2.7e258c68-33a7-4846-ba4a-43e47e8f20e3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:26 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2.7e258c68-33a7-4846-ba4a-43e47e8f20e3 Jul 10 18:31:26 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:26 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ff58f4dd-88aa-4cdc-8468-ad0ff5ef63f2 tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Acquiring lock "cinder-c259f7e4-c3dc-4741-af8b-5bb2d15b5056-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:26 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ff58f4dd-88aa-4cdc-8468-ad0ff5ef63f2 tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Lock "cinder-c259f7e4-c3dc-4741-af8b-5bb2d15b5056-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:26 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ff58f4dd-88aa-4cdc-8468-ad0ff5ef63f2 tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Acquiring lock "cinder-quobyte-c259f7e4-c3dc-4741-af8b-5bb2d15b5056" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:26 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ff58f4dd-88aa-4cdc-8468-ad0ff5ef63f2 tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Lock "cinder-quobyte-c259f7e4-c3dc-4741-af8b-5bb2d15b5056" acquired by "delete_volume" :: waited 0.023s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:26 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[902aaa9d-e157-4d44-b3fe-c19716a6d1ee]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ff58f4dd-88aa-4cdc-8468-ad0ff5ef63f2 tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:26 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1d7817cd-462f-4abb-9f9c-80107a2a565d" returned: 0 in 0.700s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:26 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:31:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.281s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:26 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-248959330',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d414483-8922-49c3-883b-6381e8ef4e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbbefa2e79fa45f6893e5f1ed789a47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:31:15Z,use_quota=True,user_id='611adf05624a48d1b579cfbdb2c41f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:31:26 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Creating volume 3d414483-8922-49c3-883b-6381e8ef4e11 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:31:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:26 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:26 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:26 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:31:26 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:31:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3d414483-8922-49c3-883b-6381e8ef4e11 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:26 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf93a82-9bc4-407b-82ad-c7f0b5f1ca12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d7817cd-462f-4abb-9f9c-80107a2a565d', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:26 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3d414483-8922-49c3-883b-6381e8ef4e11 1073741824 Jul 10 18:31:26 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:26 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (436a1442-0d05-4718-9b3d-6c31bebe6837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:26 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Volume volume-1d7817cd-462f-4abb-9f9c-80107a2a565d (1d7817cd-462f-4abb-9f9c-80107a2a565d): created successfully Jul 10 18:31:26 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (436a1442-0d05-4718-9b3d-6c31bebe6837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:26 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056 Jul 10 18:31:26 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Flow 'volume_create_manager' (2acf209a-b10d-40fc-9a5d-4099c8251c50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:31:26 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:26 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-476dd979-58cd-407b-8219-3521eaebede0 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Created volume successfully. Jul 10 18:31:26 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e654b901-40e7-4407-b149-7613d5622dd2 tempest-VolumeDependencyTests-476431000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2.7e258c68-33a7-4846-ba4a-43e47e8f20e3" returned: 0 in 0.855s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:26 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-e654b901-40e7-4407-b149-7613d5622dd2 tempest-VolumeDependencyTests-476431000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:31:26 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f129de-2744-4d3f-bf26-2463a93b5b7f]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e654b901-40e7-4407-b149-7613d5622dd2 tempest-VolumeDependencyTests-476431000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:27 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2 Jul 10 18:31:27 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:27 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ff58f4dd-88aa-4cdc-8468-ad0ff5ef63f2 tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056" returned: 0 in 0.815s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ff58f4dd-88aa-4cdc-8468-ad0ff5ef63f2 tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:27 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056 Jul 10 18:31:27 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:27 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3d414483-8922-49c3-883b-6381e8ef4e11 1073741824" returned: 0 in 0.887s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3d414483-8922-49c3-883b-6381e8ef4e11 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:27 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3d414483-8922-49c3-883b-6381e8ef4e11 Jul 10 18:31:27 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:27 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e654b901-40e7-4407-b149-7613d5622dd2 tempest-VolumeDependencyTests-476431000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2" returned: 0 in 0.856s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e654b901-40e7-4407-b149-7613d5622dd2 tempest-VolumeDependencyTests-476431000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2.7e258c68-33a7-4846-ba4a-43e47e8f20e3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:27 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2.7e258c68-33a7-4846-ba4a-43e47e8f20e3 Jul 10 18:31:27 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:27 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ff58f4dd-88aa-4cdc-8468-ad0ff5ef63f2 tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056" returned: 1 in 0.786s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ff58f4dd-88aa-4cdc-8468-ad0ff5ef63f2 tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:31:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ff58f4dd-88aa-4cdc-8468-ad0ff5ef63f2 tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:27 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056 Jul 10 18:31:27 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:28 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3d414483-8922-49c3-883b-6381e8ef4e11" returned: 0 in 0.691s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:31:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.311s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:31:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-18977539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a81e60be-4649-458c-b674-48c61ca234e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbbefa2e79fa45f6893e5f1ed789a47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:31:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:31:15Z,use_quota=True,user_id='611adf05624a48d1b579cfbdb2c41f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:31:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Creating volume a81e60be-4649-458c-b674-48c61ca234e4 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:31:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:31:28 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:31:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a81e60be-4649-458c-b674-48c61ca234e4 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5389a76c-4e03-4d87-9ce9-8633efa6317c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d414483-8922-49c3-883b-6381e8ef4e11', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6307688-1e78-4945-bfcb-7e02d77c515c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:28 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a81e60be-4649-458c-b674-48c61ca234e4 1073741824 Jul 10 18:31:28 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:28 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Volume volume-3d414483-8922-49c3-883b-6381e8ef4e11 (3d414483-8922-49c3-883b-6381e8ef4e11): created successfully Jul 10 18:31:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6307688-1e78-4945-bfcb-7e02d77c515c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Flow 'volume_create_manager' (25a50fbd-9baa-485f-adec-10749b7e8016) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:31:28 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-9f3b712b-c105-4fb2-b6e4-029805903063 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Created volume successfully. Jul 10 18:31:28 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e654b901-40e7-4407-b149-7613d5622dd2 tempest-VolumeDependencyTests-476431000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2.7e258c68-33a7-4846-ba4a-43e47e8f20e3" returned: 0 in 0.823s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e654b901-40e7-4407-b149-7613d5622dd2 tempest-VolumeDependencyTests-476431000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2.7e258c68-33a7-4846-ba4a-43e47e8f20e3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:28 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2.7e258c68-33a7-4846-ba4a-43e47e8f20e3 Jul 10 18:31:28 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:28 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ff58f4dd-88aa-4cdc-8468-ad0ff5ef63f2 tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c259f7e4-c3dc-4741-af8b-5bb2d15b5056" returned: 0 in 0.731s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:28 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ff58f4dd-88aa-4cdc-8468-ad0ff5ef63f2 tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Lock "cinder-quobyte-c259f7e4-c3dc-4741-af8b-5bb2d15b5056" released by "delete_volume" :: held 2.409s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:28 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-ff58f4dd-88aa-4cdc-8468-ad0ff5ef63f2 tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Created reservations ['ac0087d5-4316-46e3-8683-7431df501d7a', 'ecadef73-9906-446d-ab82-8a7ae087c974', '564fcdad-8a48-4ed7-8167-83ff8b0f31e6', '01691f2d-2310-4448-8136-09438edce535'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:31:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ff58f4dd-88aa-4cdc-8468-ad0ff5ef63f2 tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ff58f4dd-88aa-4cdc-8468-ad0ff5ef63f2 tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ff58f4dd-88aa-4cdc-8468-ad0ff5ef63f2 tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ff58f4dd-88aa-4cdc-8468-ad0ff5ef63f2 tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ff58f4dd-88aa-4cdc-8468-ad0ff5ef63f2 tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ff58f4dd-88aa-4cdc-8468-ad0ff5ef63f2 tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:28 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:31:28 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:29 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a81e60be-4649-458c-b674-48c61ca234e4 1073741824" returned: 0 in 0.948s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a81e60be-4649-458c-b674-48c61ca234e4 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:29 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a81e60be-4649-458c-b674-48c61ca234e4 Jul 10 18:31:29 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:29 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e654b901-40e7-4407-b149-7613d5622dd2 tempest-VolumeDependencyTests-476431000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2.7e258c68-33a7-4846-ba4a-43e47e8f20e3" returned: 0 in 0.692s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e654b901-40e7-4407-b149-7613d5622dd2 tempest-VolumeDependencyTests-476431000 None] Lock "cinder-quobyte-7e258c68-33a7-4846-ba4a-43e47e8f20e3" released by "_delete_snapshot" :: held 3.339s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e654b901-40e7-4407-b149-7613d5622dd2 tempest-VolumeDependencyTests-476431000 None] Lock "cinder-quobyte-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2" released by "delete_snapshot" :: held 3.364s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:29 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-e654b901-40e7-4407-b149-7613d5622dd2 tempest-VolumeDependencyTests-476431000 None] Created reservations ['05f88212-e1f9-47be-8113-9764334b63b7', 'e39b0ce8-4c0a-4a00-a54f-4c20b85d018c', '946210d3-d10c-4818-9a49-1ef6b7a99296', 'eac064ae-f1df-4ecf-b80d-9ffc32aa86c7'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:31:29 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-e654b901-40e7-4407-b149-7613d5622dd2 tempest-VolumeDependencyTests-476431000 None] Delete snapshot completed successfully. Jul 10 18:31:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e654b901-40e7-4407-b149-7613d5622dd2 tempest-VolumeDependencyTests-476431000 None] Lock "cinder-7e258c68-33a7-4846-ba4a-43e47e8f20e3-delete_snapshot" released by "delete_snapshot" :: held 3.544s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:29 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ff58f4dd-88aa-4cdc-8468-ad0ff5ef63f2 tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.679s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:29 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-ff58f4dd-88aa-4cdc-8468-ad0ff5ef63f2 tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:31:29 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-ff58f4dd-88aa-4cdc-8468-ad0ff5ef63f2 tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Deleted volume successfully. Jul 10 18:31:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ff58f4dd-88aa-4cdc-8468-ad0ff5ef63f2 tempest-VolumeAndVolumeTypeFromImageTest-1511104921 None] Lock "cinder-c259f7e4-c3dc-4741-af8b-5bb2d15b5056-delete_volume" released by "delete_volume" :: held 3.352s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:29 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a81e60be-4649-458c-b674-48c61ca234e4" returned: 0 in 0.700s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:31:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.600s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1906187043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=379df739-3baf-425e-bbb4-e2abc1d72145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbbefa2e79fa45f6893e5f1ed789a47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:31:16Z,use_quota=True,user_id='611adf05624a48d1b579cfbdb2c41f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:31:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Creating volume 379df739-3baf-425e-bbb4-e2abc1d72145 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:31:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:31:29 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:31:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-379df739-3baf-425e-bbb4-e2abc1d72145 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e0d388-155f-49e7-b4f3-04ede036dd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a81e60be-4649-458c-b674-48c61ca234e4', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:29 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-379df739-3baf-425e-bbb4-e2abc1d72145 1073741824 Jul 10 18:31:29 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fafa34b-7986-4933-bb07-47a9d23a9131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:29 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Volume volume-a81e60be-4649-458c-b674-48c61ca234e4 (a81e60be-4649-458c-b674-48c61ca234e4): created successfully Jul 10 18:31:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fafa34b-7986-4933-bb07-47a9d23a9131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:29 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Flow 'volume_create_manager' (58489aed-a561-45c3-9ae0-6ffa119d983e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:31:29 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-7f215f4a-e7af-45bf-af39-f9840a572517 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Created volume successfully. Jul 10 18:31:30 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a1037558-00bc-4770-9909-63b9eb2b872b tempest-VolumeDependencyTests-476431000 None] Acquiring lock "cinder-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:30 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a1037558-00bc-4770-9909-63b9eb2b872b tempest-VolumeDependencyTests-476431000 None] Lock "cinder-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:30 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a1037558-00bc-4770-9909-63b9eb2b872b tempest-VolumeDependencyTests-476431000 None] Acquiring lock "cinder-quobyte-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:30 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a1037558-00bc-4770-9909-63b9eb2b872b tempest-VolumeDependencyTests-476431000 None] Lock "cinder-quobyte-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2" acquired by "delete_volume" :: waited 0.021s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:30 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[687ff391-dca9-4532-8228-cc37740e6730]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a1037558-00bc-4770-9909-63b9eb2b872b tempest-VolumeDependencyTests-476431000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:30 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2 Jul 10 18:31:30 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:30 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-379df739-3baf-425e-bbb4-e2abc1d72145 1073741824" returned: 0 in 0.913s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-379df739-3baf-425e-bbb4-e2abc1d72145 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:30 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-379df739-3baf-425e-bbb4-e2abc1d72145 Jul 10 18:31:30 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:31 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a1037558-00bc-4770-9909-63b9eb2b872b tempest-VolumeDependencyTests-476431000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2" returned: 0 in 0.876s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a1037558-00bc-4770-9909-63b9eb2b872b tempest-VolumeDependencyTests-476431000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:31 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2 Jul 10 18:31:31 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:31 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-379df739-3baf-425e-bbb4-e2abc1d72145" returned: 0 in 0.806s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:31 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:31:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.871s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:31 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-877828397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc52dfbb-6b01-42cc-848e-0d7c00b353f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbbefa2e79fa45f6893e5f1ed789a47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:31:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:31:16Z,use_quota=True,user_id='611adf05624a48d1b579cfbdb2c41f63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:31:31 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] Creating volume fc52dfbb-6b01-42cc-848e-0d7c00b353f6 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:31:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:31 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:31 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:31 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:31:31 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:31:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fc52dfbb-6b01-42cc-848e-0d7c00b353f6 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db42068-0e2e-4f81-b624-b4c3e3b9e17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-379df739-3baf-425e-bbb4-e2abc1d72145', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d223e5f6-9c93-4e9f-ba73-960bbe0c5690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:31 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Volume volume-379df739-3baf-425e-bbb4-e2abc1d72145 (379df739-3baf-425e-bbb4-e2abc1d72145): created successfully Jul 10 18:31:31 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fc52dfbb-6b01-42cc-848e-0d7c00b353f6 1073741824 Jul 10 18:31:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d223e5f6-9c93-4e9f-ba73-960bbe0c5690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:31 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Flow 'volume_create_manager' (fb868095-615c-4461-8296-8b05114d9abf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:31:31 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-0ec1fd2f-3afa-4e00-9b13-592a1c654393 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Created volume successfully. Jul 10 18:31:32 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a1037558-00bc-4770-9909-63b9eb2b872b tempest-VolumeDependencyTests-476431000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2" returned: 0 in 0.787s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:32 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a1037558-00bc-4770-9909-63b9eb2b872b tempest-VolumeDependencyTests-476431000 None] Lock "cinder-quobyte-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2" released by "delete_volume" :: held 1.744s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:32 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-a1037558-00bc-4770-9909-63b9eb2b872b tempest-VolumeDependencyTests-476431000 None] Created reservations ['a0c88643-0252-476e-a48f-53b2302ee0bb', '0bccf787-7286-40a7-b706-026df31d8899', 'b1d8e71d-9fdf-4595-be19-79b56e3ba46e', 'b13ee8d0-2e78-4ae7-969e-79464d1f230a'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:31:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a1037558-00bc-4770-9909-63b9eb2b872b tempest-VolumeDependencyTests-476431000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a1037558-00bc-4770-9909-63b9eb2b872b tempest-VolumeDependencyTests-476431000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a1037558-00bc-4770-9909-63b9eb2b872b tempest-VolumeDependencyTests-476431000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a1037558-00bc-4770-9909-63b9eb2b872b tempest-VolumeDependencyTests-476431000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a1037558-00bc-4770-9909-63b9eb2b872b tempest-VolumeDependencyTests-476431000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a1037558-00bc-4770-9909-63b9eb2b872b tempest-VolumeDependencyTests-476431000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:32 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:31:32 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:32 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2fa92b96-c7d3-4f8f-99e7-f4f6fd55caba tempest-VolumeDependencyTests-476431000 None] Acquiring lock "cinder-db26ad12-1902-4c2e-87e6-105ef710850d-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:32 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2fa92b96-c7d3-4f8f-99e7-f4f6fd55caba tempest-VolumeDependencyTests-476431000 None] Lock "cinder-db26ad12-1902-4c2e-87e6-105ef710850d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:32 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fc52dfbb-6b01-42cc-848e-0d7c00b353f6 1073741824" returned: 0 in 1.077s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:32 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2fa92b96-c7d3-4f8f-99e7-f4f6fd55caba tempest-VolumeDependencyTests-476431000 None] Acquiring lock "cinder-quobyte-db26ad12-1902-4c2e-87e6-105ef710850d" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:32 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2fa92b96-c7d3-4f8f-99e7-f4f6fd55caba tempest-VolumeDependencyTests-476431000 None] Lock "cinder-quobyte-db26ad12-1902-4c2e-87e6-105ef710850d" acquired by "delete_volume" :: waited 0.020s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fc52dfbb-6b01-42cc-848e-0d7c00b353f6 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:32 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06cd684-527e-4c16-9607-5e9e8c600eee]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2fa92b96-c7d3-4f8f-99e7-f4f6fd55caba tempest-VolumeDependencyTests-476431000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db26ad12-1902-4c2e-87e6-105ef710850d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:32 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fc52dfbb-6b01-42cc-848e-0d7c00b353f6 Jul 10 18:31:32 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:32 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db26ad12-1902-4c2e-87e6-105ef710850d Jul 10 18:31:32 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:32 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a1037558-00bc-4770-9909-63b9eb2b872b tempest-VolumeDependencyTests-476431000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.815s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:32 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-a1037558-00bc-4770-9909-63b9eb2b872b tempest-VolumeDependencyTests-476431000 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:31:33 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-a1037558-00bc-4770-9909-63b9eb2b872b tempest-VolumeDependencyTests-476431000 None] Deleted volume successfully. Jul 10 18:31:33 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a1037558-00bc-4770-9909-63b9eb2b872b tempest-VolumeDependencyTests-476431000 None] Lock "cinder-42efa7c6-b4ed-4ccb-bbc8-9b5ab1b506a2-delete_volume" released by "delete_volume" :: held 2.811s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:33 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fc52dfbb-6b01-42cc-848e-0d7c00b353f6" returned: 0 in 0.725s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:33 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] <== create_volume: return (1881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:31:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.491s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:33 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-143827185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d1e6829-9cf0-499a-bf9e-ed94727d3ae2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bdebbc27cc745e1a7d011316ca44ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:31:21Z,use_quota=True,user_id='a71ea1188e134470bdec99d18107bd26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:31:33 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Creating volume 1d1e6829-9cf0-499a-bf9e-ed94727d3ae2 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:31:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:33 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:33 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:33 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:31:33 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:31:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1d1e6829-9cf0-499a-bf9e-ed94727d3ae2 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:33 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (351eb598-1ff0-42e4-9ce3-0f5bcd4f1f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc52dfbb-6b01-42cc-848e-0d7c00b353f6', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:33 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9906362e-2134-4cd7-9d48-3696d3eecc03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:33 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1d1e6829-9cf0-499a-bf9e-ed94727d3ae2 1073741824 Jul 10 18:31:33 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:33 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] Volume volume-fc52dfbb-6b01-42cc-848e-0d7c00b353f6 (fc52dfbb-6b01-42cc-848e-0d7c00b353f6): created successfully Jul 10 18:31:33 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9906362e-2134-4cd7-9d48-3696d3eecc03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:33 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] Flow 'volume_create_manager' (8eb276e5-7440-4bda-8b24-e283e10d2711) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:31:33 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-1b2a1bf7-6a88-476b-9b45-07bf7bf215ed tempest-CreateVolumesFromSnapshotTest-2132304058 None] Created volume successfully. Jul 10 18:31:33 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2fa92b96-c7d3-4f8f-99e7-f4f6fd55caba tempest-VolumeDependencyTests-476431000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db26ad12-1902-4c2e-87e6-105ef710850d" returned: 0 in 0.876s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2fa92b96-c7d3-4f8f-99e7-f4f6fd55caba tempest-VolumeDependencyTests-476431000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db26ad12-1902-4c2e-87e6-105ef710850d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:33 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db26ad12-1902-4c2e-87e6-105ef710850d Jul 10 18:31:33 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:34 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a903f00b-9e20-4a7b-9c8b-58c0f6f47038 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "cinder-fc52dfbb-6b01-42cc-848e-0d7c00b353f6-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:34 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a903f00b-9e20-4a7b-9c8b-58c0f6f47038 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "cinder-fc52dfbb-6b01-42cc-848e-0d7c00b353f6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:34 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2fa92b96-c7d3-4f8f-99e7-f4f6fd55caba tempest-VolumeDependencyTests-476431000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-db26ad12-1902-4c2e-87e6-105ef710850d" returned: 0 in 0.744s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:34 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a903f00b-9e20-4a7b-9c8b-58c0f6f47038 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "cinder-quobyte-fc52dfbb-6b01-42cc-848e-0d7c00b353f6" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:34 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2fa92b96-c7d3-4f8f-99e7-f4f6fd55caba tempest-VolumeDependencyTests-476431000 None] Lock "cinder-quobyte-db26ad12-1902-4c2e-87e6-105ef710850d" released by "delete_volume" :: held 1.685s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:34 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a903f00b-9e20-4a7b-9c8b-58c0f6f47038 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "cinder-quobyte-fc52dfbb-6b01-42cc-848e-0d7c00b353f6" acquired by "delete_volume" :: waited 0.033s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:34 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4ddb0f-7774-4d7f-811a-5d808e3e81e9]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a903f00b-9e20-4a7b-9c8b-58c0f6f47038 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fc52dfbb-6b01-42cc-848e-0d7c00b353f6 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:34 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1d1e6829-9cf0-499a-bf9e-ed94727d3ae2 1073741824" returned: 0 in 0.985s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1d1e6829-9cf0-499a-bf9e-ed94727d3ae2 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:34 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-2fa92b96-c7d3-4f8f-99e7-f4f6fd55caba tempest-VolumeDependencyTests-476431000 None] Created reservations ['ff08f1d8-35db-4c2d-b368-90a98a153a9f', '2d748ef1-cc3b-4fee-9ba0-1f64b3990e79', 'bee263d3-1c13-478b-91b2-7a44bfdbfe7c', '5505ef1f-f748-4f07-baad-6b69e379ccd0'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:31:34 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1d1e6829-9cf0-499a-bf9e-ed94727d3ae2 Jul 10 18:31:34 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:34 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fc52dfbb-6b01-42cc-848e-0d7c00b353f6 Jul 10 18:31:34 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2fa92b96-c7d3-4f8f-99e7-f4f6fd55caba tempest-VolumeDependencyTests-476431000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2fa92b96-c7d3-4f8f-99e7-f4f6fd55caba tempest-VolumeDependencyTests-476431000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:34 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-2fa92b96-c7d3-4f8f-99e7-f4f6fd55caba tempest-VolumeDependencyTests-476431000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:34 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-2fa92b96-c7d3-4f8f-99e7-f4f6fd55caba tempest-VolumeDependencyTests-476431000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2fa92b96-c7d3-4f8f-99e7-f4f6fd55caba tempest-VolumeDependencyTests-476431000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2fa92b96-c7d3-4f8f-99e7-f4f6fd55caba tempest-VolumeDependencyTests-476431000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:34 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:31:34 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:35 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1d1e6829-9cf0-499a-bf9e-ed94727d3ae2" returned: 0 in 0.833s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:31:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d162e0b0-ab16-45eb-a4af-5c2313b7f087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d1e6829-9cf0-499a-bf9e-ed94727d3ae2', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef96df35-6a27-45f8-b0c3-73a6b4a97442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:35 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Volume volume-1d1e6829-9cf0-499a-bf9e-ed94727d3ae2 (1d1e6829-9cf0-499a-bf9e-ed94727d3ae2): created successfully Jul 10 18:31:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef96df35-6a27-45f8-b0c3-73a6b4a97442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:35 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Flow 'volume_create_manager' (f4f4a49d-881a-4f8e-b8ca-05aeb65e7e27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:31:35 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a903f00b-9e20-4a7b-9c8b-58c0f6f47038 tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fc52dfbb-6b01-42cc-848e-0d7c00b353f6" returned: 0 in 1.010s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a903f00b-9e20-4a7b-9c8b-58c0f6f47038 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fc52dfbb-6b01-42cc-848e-0d7c00b353f6 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:35 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-d02e2b85-d87f-4479-8cad-028b62cbe3f1 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Created volume successfully. Jul 10 18:31:35 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fc52dfbb-6b01-42cc-848e-0d7c00b353f6 Jul 10 18:31:35 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:35 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2fa92b96-c7d3-4f8f-99e7-f4f6fd55caba tempest-VolumeDependencyTests-476431000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.975s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:35 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-2fa92b96-c7d3-4f8f-99e7-f4f6fd55caba tempest-VolumeDependencyTests-476431000 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:31:35 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-2fa92b96-c7d3-4f8f-99e7-f4f6fd55caba tempest-VolumeDependencyTests-476431000 None] Deleted volume successfully. Jul 10 18:31:35 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2fa92b96-c7d3-4f8f-99e7-f4f6fd55caba tempest-VolumeDependencyTests-476431000 None] Lock "cinder-db26ad12-1902-4c2e-87e6-105ef710850d-delete_volume" released by "delete_volume" :: held 3.009s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:36 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a903f00b-9e20-4a7b-9c8b-58c0f6f47038 tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fc52dfbb-6b01-42cc-848e-0d7c00b353f6" returned: 0 in 0.758s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:36 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a903f00b-9e20-4a7b-9c8b-58c0f6f47038 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "cinder-quobyte-fc52dfbb-6b01-42cc-848e-0d7c00b353f6" released by "delete_volume" :: held 1.818s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:36 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-a903f00b-9e20-4a7b-9c8b-58c0f6f47038 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Created reservations ['22416979-e963-463f-94be-7faeecd78ea9', '33a3865b-ec5a-4507-b713-94849255293c', '9c80c507-e108-49b4-9e40-d01f9e1ef677', '3b097111-fceb-454b-9b3b-7dfe33340270'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:31:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a903f00b-9e20-4a7b-9c8b-58c0f6f47038 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a903f00b-9e20-4a7b-9c8b-58c0f6f47038 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a903f00b-9e20-4a7b-9c8b-58c0f6f47038 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a903f00b-9e20-4a7b-9c8b-58c0f6f47038 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a903f00b-9e20-4a7b-9c8b-58c0f6f47038 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a903f00b-9e20-4a7b-9c8b-58c0f6f47038 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:36 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:31:36 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:36 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-38e88be6-1a3a-45ae-92a2-6a7ef3ddd2c7 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "cinder-379df739-3baf-425e-bbb4-e2abc1d72145-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:36 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-38e88be6-1a3a-45ae-92a2-6a7ef3ddd2c7 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "cinder-379df739-3baf-425e-bbb4-e2abc1d72145-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-38e88be6-1a3a-45ae-92a2-6a7ef3ddd2c7 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "cinder-quobyte-379df739-3baf-425e-bbb4-e2abc1d72145" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-38e88be6-1a3a-45ae-92a2-6a7ef3ddd2c7 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "cinder-quobyte-379df739-3baf-425e-bbb4-e2abc1d72145" acquired by "delete_volume" :: waited 0.041s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdc062f-1be6-461e-8bdb-b0e88c935fb7]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-38e88be6-1a3a-45ae-92a2-6a7ef3ddd2c7 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-379df739-3baf-425e-bbb4-e2abc1d72145 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:37 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a903f00b-9e20-4a7b-9c8b-58c0f6f47038 tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.882s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-a903f00b-9e20-4a7b-9c8b-58c0f6f47038 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:31:37 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-a903f00b-9e20-4a7b-9c8b-58c0f6f47038 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Deleted volume successfully. Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Flow 'volume_create_manager' (76d20de6-3baa-4b99-a06f-47c29cbbc2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c61dedbf-a93a-4bb3-adc0-2d5b0e1cd892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-a903f00b-9e20-4a7b-9c8b-58c0f6f47038 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "cinder-fc52dfbb-6b01-42cc-848e-0d7c00b353f6-delete_volume" released by "delete_volume" :: held 3.047s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c61dedbf-a93a-4bb3-adc0-2d5b0e1cd892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1250641166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d1556f5-98c5-47a9-87b2-83670fbaf5e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bdebbc27cc745e1a7d011316ca44ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:31:37Z,use_quota=True,user_id='a71ea1188e134470bdec99d18107bd26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e0c19d9-35d4-47d4-9173-f7700a4f49a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e0c19d9-35d4-47d4-9173-f7700a4f49a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699ddd1f-173e-4952-87f2-3f0e868220cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (699ddd1f-173e-4952-87f2-3f0e868220cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d1556f5-98c5-47a9-87b2-83670fbaf5e8', 'volume_name': 'volume-3d1556f5-98c5-47a9-87b2-83670fbaf5e8', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef4b82f-1bd2-43da-8221-d129b3ab8915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ef4b82f-1bd2-43da-8221-d129b3ab8915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:37 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-379df739-3baf-425e-bbb4-e2abc1d72145 Jul 10 18:31:37 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9eebdbf-7522-419f-8cf4-cc4c953ca4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:37 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Volume 3d1556f5-98c5-47a9-87b2-83670fbaf5e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d1556f5-98c5-47a9-87b2-83670fbaf5e8', 'volume_size': 1} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1250641166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d1556f5-98c5-47a9-87b2-83670fbaf5e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bdebbc27cc745e1a7d011316ca44ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:31:37Z,use_quota=True,user_id='a71ea1188e134470bdec99d18107bd26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Creating volume 3d1556f5-98c5-47a9-87b2-83670fbaf5e8 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:31:37 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3d1556f5-98c5-47a9-87b2-83670fbaf5e8 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:37 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3d1556f5-98c5-47a9-87b2-83670fbaf5e8 1073741824 Jul 10 18:31:37 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Flow 'volume_create_manager' (17b7d5bc-eb43-4e3d-98d8-dd5f7b672a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f5979f4-ccc4-4010-ba8b-a4d354a82719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f5979f4-ccc4-4010-ba8b-a4d354a82719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b1dfdd-5349-4ec3-bab7-426e5242d447,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda813ed52974cf48682a9934f78d3e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:31:37Z,use_quota=True,user_id='8f3f40d8ff8d4971b54f04cae6841379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcec3abf-627f-45cb-87ce-9486e09bfdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcec3abf-627f-45cb-87ce-9486e09bfdef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (671c89f1-e28f-41b8-800c-5d29597996f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.image.glance [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Creating Keystone auth plugin from conf {{(pid=87399) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Flow 'volume_create_manager' (2ec43352-5324-426b-81d1-41929de34e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (253d5152-1911-40f6-9a7d-f7befd80c3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (253d5152-1911-40f6-9a7d-f7befd80c3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1282732342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f7ecc3f-b67d-4bcf-948c-d03bcf0941a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bdebbc27cc745e1a7d011316ca44ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:31:38Z,use_quota=True,user_id='a71ea1188e134470bdec99d18107bd26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0806fe05-df20-4c66-b77b-d7de0b03a0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0806fe05-df20-4c66-b77b-d7de0b03a0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a27bce2-e0df-4bb2-8e24-1943af9deeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a27bce2-e0df-4bb2-8e24-1943af9deeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f7ecc3f-b67d-4bcf-948c-d03bcf0941a3', 'volume_name': 'volume-9f7ecc3f-b67d-4bcf-948c-d03bcf0941a3', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd5ec10-02a2-4896-819a-222383010066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd5ec10-02a2-4896-819a-222383010066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (412a8d6e-da6d-4218-aab7-00fefb38d5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:37 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Volume 9f7ecc3f-b67d-4bcf-948c-d03bcf0941a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f7ecc3f-b67d-4bcf-948c-d03bcf0941a3', 'volume_size': 1} Jul 10 18:31:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (671c89f1-e28f-41b8-800c-5d29597996f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '15b1dfdd-5349-4ec3-bab7-426e5242d447', 'volume_name': 'volume-15b1dfdd-5349-4ec3-bab7-426e5242d447', 'volume_size': 1, 'image_id': 'b4563992-7257-471b-a651-8ccecd8ae81d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4563992-7257-471b-a651-8ccecd8ae81d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a19da89473d9f9b90a8b4ab0a45c4498', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cda813ed52974cf48682a9934f78d3e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '04d06ab5bb3b8ac5ed04c72440c647d30a48ae22070d855b801462c19751af011985d12b76bc9247570befbf6d72555fa264817bceeae1fcd18a46eab1421310', 'id': 'b4563992-7257-471b-a651-8ccecd8ae81d', 'created_at': datetime.datetime(2026, 7, 10, 16, 31, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 16, 31, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4563992-7257-471b-a651-8ccecd8ae81d/file', 'properties': {}}, 'image_service': }' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b470d3b1-78f7-4f00-97fe-9f6cf1c361a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b470d3b1-78f7-4f00-97fe-9f6cf1c361a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67ede721-a467-41eb-af30-bad8eb9f78c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:38 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Volume 15b1dfdd-5349-4ec3-bab7-426e5242d447: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-15b1dfdd-5349-4ec3-bab7-426e5242d447', 'volume_size': 1, 'image_id': 'b4563992-7257-471b-a651-8ccecd8ae81d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4563992-7257-471b-a651-8ccecd8ae81d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a19da89473d9f9b90a8b4ab0a45c4498', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cda813ed52974cf48682a9934f78d3e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '04d06ab5bb3b8ac5ed04c72440c647d30a48ae22070d855b801462c19751af011985d12b76bc9247570befbf6d72555fa264817bceeae1fcd18a46eab1421310', 'id': 'b4563992-7257-471b-a651-8ccecd8ae81d', 'created_at': datetime.datetime(2026, 7, 10, 16, 31, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 16, 31, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4563992-7257-471b-a651-8ccecd8ae81d/file', 'properties': {}}, 'image_service': } Jul 10 18:31:38 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Trying to clone 15b1dfdd-5349-4ec3-bab7-426e5242d447 from image b4563992-7257-471b-a651-8ccecd8ae81d at location (None, [{'url': 'file:///opt/stack/data/glance/images/b4563992-7257-471b-a651-8ccecd8ae81d', 'metadata': {}}]). {{(pid=87399) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 18:31:38 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:31:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Flow 'volume_create_manager' (453fb2b2-cfc5-43dd-a7e8-082cebaacc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:31:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53896b15-a5ff-4ffe-8300-213a81faa40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53896b15-a5ff-4ffe-8300-213a81faa40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1196039707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acdb109f-92d2-413d-afad-b0db2eb6ce50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bdebbc27cc745e1a7d011316ca44ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:31:38Z,use_quota=True,user_id='a71ea1188e134470bdec99d18107bd26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6618784-9ae1-4aa0-bf46-29812a901297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6618784-9ae1-4aa0-bf46-29812a901297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7c939ee-2bf2-482a-8562-097137bc07ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7c939ee-2bf2-482a-8562-097137bc07ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acdb109f-92d2-413d-afad-b0db2eb6ce50', 'volume_name': 'volume-acdb109f-92d2-413d-afad-b0db2eb6ce50', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30289f5d-7543-4f02-99d8-0edf58727175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30289f5d-7543-4f02-99d8-0edf58727175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:38 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce5f37c1-af3e-48a3-8cd6-e6c1a1c6afba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:38 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Volume acdb109f-92d2-413d-afad-b0db2eb6ce50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acdb109f-92d2-413d-afad-b0db2eb6ce50', 'volume_size': 1} Jul 10 18:31:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-38e88be6-1a3a-45ae-92a2-6a7ef3ddd2c7 tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-379df739-3baf-425e-bbb4-e2abc1d72145" returned: 0 in 1.563s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-38e88be6-1a3a-45ae-92a2-6a7ef3ddd2c7 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-379df739-3baf-425e-bbb4-e2abc1d72145 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:38 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b4563992-7257-471b-a651-8ccecd8ae81d_dzasy2r3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87399) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 10 18:31:38 devstack cinder-volume[87399]: INFO cinder.image.image_utils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Image download 0.00 MB at 0.00 MB/s Jul 10 18:31:38 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-379df739-3baf-425e-bbb4-e2abc1d72145 Jul 10 18:31:38 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:38 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e70143-fcc2-4491-9633-7a063444823e]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4563992-7257-471b-a651-8ccecd8ae81d_dzasy2r3devstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:38 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3d1556f5-98c5-47a9-87b2-83670fbaf5e8 1073741824" returned: 0 in 1.514s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3d1556f5-98c5-47a9-87b2-83670fbaf5e8 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:39 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4563992-7257-471b-a651-8ccecd8ae81d_dzasy2r3devstack@QuobyteHD Jul 10 18:31:39 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:39 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3d1556f5-98c5-47a9-87b2-83670fbaf5e8 Jul 10 18:31:39 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:39 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:31:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Flow 'volume_create_manager' (e2805c68-78cf-4fc1-8026-2e5f8ce201e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:31:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4852e262-fc66-4e01-b924-32c72931a7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4852e262-fc66-4e01-b924-32c72931a7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1893207630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4880529a-840c-46ad-9088-8222dcb46011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bdebbc27cc745e1a7d011316ca44ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:31:39Z,use_quota=True,user_id='a71ea1188e134470bdec99d18107bd26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dea7360f-665e-4e13-b7a1-7051ddc6c5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dea7360f-665e-4e13-b7a1-7051ddc6c5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (810c56a8-77b9-4e6b-9abb-bfbe7b1106cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (810c56a8-77b9-4e6b-9abb-bfbe7b1106cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4880529a-840c-46ad-9088-8222dcb46011', 'volume_name': 'volume-4880529a-840c-46ad-9088-8222dcb46011', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91b6eed-287a-44b2-b555-9a8faa4e8931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f91b6eed-287a-44b2-b555-9a8faa4e8931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:39 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85b90ed8-77f6-44df-831f-506476523124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:39 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Volume 4880529a-840c-46ad-9088-8222dcb46011: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4880529a-840c-46ad-9088-8222dcb46011', 'volume_size': 1} Jul 10 18:31:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:39 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-38e88be6-1a3a-45ae-92a2-6a7ef3ddd2c7 tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-379df739-3baf-425e-bbb4-e2abc1d72145" returned: 0 in 1.254s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:39 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-38e88be6-1a3a-45ae-92a2-6a7ef3ddd2c7 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "cinder-quobyte-379df739-3baf-425e-bbb4-e2abc1d72145" released by "delete_volume" :: held 2.890s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:39 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:39 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3d1556f5-98c5-47a9-87b2-83670fbaf5e8" returned: 0 in 1.005s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:39 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] <== create_volume: return (2595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:31:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.598s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4563992-7257-471b-a651-8ccecd8ae81d_dzasy2r3devstack@QuobyteHD" returned: 0 in 1.189s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.041s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1282732342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f7ecc3f-b67d-4bcf-948c-d03bcf0941a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bdebbc27cc745e1a7d011316ca44ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:31:38Z,use_quota=True,user_id='a71ea1188e134470bdec99d18107bd26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Creating volume 9f7ecc3f-b67d-4bcf-948c-d03bcf0941a3 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:31:40 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9f7ecc3f-b67d-4bcf-948c-d03bcf0941a3 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4563992-7257-471b-a651-8ccecd8ae81d_dzasy2r3devstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:31:40 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9f7ecc3f-b67d-4bcf-948c-d03bcf0941a3 1073741824 Jul 10 18:31:40 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Flow 'volume_create_manager' (5168197e-af1b-47cc-ac6c-35ad6b996a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4911c80-5452-446d-9fc1-7d0ce7c7a634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9eebdbf-7522-419f-8cf4-cc4c953ca4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d1556f5-98c5-47a9-87b2-83670fbaf5e8', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f6ad6b0-cb98-48fb-9db4-305a577a3836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4911c80-5452-446d-9fc1-7d0ce7c7a634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1448524424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ec4cd2-43d9-424e-a431-637a654d4b19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bdebbc27cc745e1a7d011316ca44ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:31:40Z,use_quota=True,user_id='a71ea1188e134470bdec99d18107bd26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c9365f2-34da-4089-bdc2-72beb77858ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c9365f2-34da-4089-bdc2-72beb77858ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50152f9c-eeeb-4711-857d-846a9210a08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50152f9c-eeeb-4711-857d-846a9210a08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8ec4cd2-43d9-424e-a431-637a654d4b19', 'volume_name': 'volume-c8ec4cd2-43d9-424e-a431-637a654d4b19', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:40 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4563992-7257-471b-a651-8ccecd8ae81d_dzasy2r3devstack@QuobyteHD Jul 10 18:31:40 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2b2bef0-3ab3-4228-a953-ca6482cf437f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2b2bef0-3ab3-4228-a953-ca6482cf437f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd9be3b9-03c4-47b7-9bc5-46dde294f3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:40 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Volume c8ec4cd2-43d9-424e-a431-637a654d4b19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8ec4cd2-43d9-424e-a431-637a654d4b19', 'volume_size': 1} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:40 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Volume volume-3d1556f5-98c5-47a9-87b2-83670fbaf5e8 (3d1556f5-98c5-47a9-87b2-83670fbaf5e8): created successfully Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f6ad6b0-cb98-48fb-9db4-305a577a3836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Flow 'volume_create_manager' (76d20de6-3baa-4b99-a06f-47c29cbbc2c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:31:40 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-f8ac4c3b-aeab-40df-a427-b2ff496c64a9 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Created volume successfully. Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-38e88be6-1a3a-45ae-92a2-6a7ef3ddd2c7 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Created reservations ['cf6af9d7-c2cd-4e45-b459-98eebd5e4cba', 'cc6aa154-6402-44b0-9dcf-eccaa66e4f1f', '13f367ce-576d-4282-8dd5-ef47573885d6', '9d6ef901-d8f2-4a82-be7f-d1f7974f2d97'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-38e88be6-1a3a-45ae-92a2-6a7ef3ddd2c7 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-38e88be6-1a3a-45ae-92a2-6a7ef3ddd2c7 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-38e88be6-1a3a-45ae-92a2-6a7ef3ddd2c7 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-38e88be6-1a3a-45ae-92a2-6a7ef3ddd2c7 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-38e88be6-1a3a-45ae-92a2-6a7ef3ddd2c7 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-38e88be6-1a3a-45ae-92a2-6a7ef3ddd2c7 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:31:40 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:31:40 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] Flow 'volume_create_manager' (fbf60292-be98-4f42-be69-639f51e5644b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a253e18f-a5d8-48df-a61c-85a9f50d77fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a253e18f-a5d8-48df-a61c-85a9f50d77fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-435637149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b58c1644-3cd8-4544-8412-2724bede6747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='935a1657e6614ac3a2269f04e097247e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:31:40Z,use_quota=True,user_id='bf797658fda948239bec7f0bcb759bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c4de60e-48c2-43dc-9f39-1a815a75bd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c4de60e-48c2-43dc-9f39-1a815a75bd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f1403d3-f13f-444a-98b8-07c85cf45afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f1403d3-f13f-444a-98b8-07c85cf45afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b58c1644-3cd8-4544-8412-2724bede6747', 'volume_name': 'volume-b58c1644-3cd8-4544-8412-2724bede6747', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de5298c7-ba60-414f-aa4a-f68ee8e7e095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de5298c7-ba60-414f-aa4a-f68ee8e7e095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (815ef3d8-bb73-459e-b29b-a5aefdf708dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:40 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] Volume b58c1644-3cd8-4544-8412-2724bede6747: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b58c1644-3cd8-4544-8412-2724bede6747', 'volume_size': 1} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:40 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4563992-7257-471b-a651-8ccecd8ae81d_dzasy2r3devstack@QuobyteHD" returned: 1 in 0.813s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4563992-7257-471b-a651-8ccecd8ae81d_dzasy2r3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Temporary image b4563992-7257-471b-a651-8ccecd8ae81d is fetched for user 8f3f40d8ff8d4971b54f04cae6841379. {{(pid=87399) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-54d5d298-a0e5-4e28-a2cd-e0982ba83097 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "cinder-a81e60be-4649-458c-b674-48c61ca234e4-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-54d5d298-a0e5-4e28-a2cd-e0982ba83097 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "cinder-a81e60be-4649-458c-b674-48c61ca234e4-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ca79e9-d391-4d7e-898e-a527c13839c6]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4563992-7257-471b-a651-8ccecd8ae81d_dzasy2r3devstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:41 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-54d5d298-a0e5-4e28-a2cd-e0982ba83097 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "cinder-quobyte-a81e60be-4649-458c-b674-48c61ca234e4" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:41 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-54d5d298-a0e5-4e28-a2cd-e0982ba83097 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "cinder-quobyte-a81e60be-4649-458c-b674-48c61ca234e4" acquired by "delete_volume" :: waited 0.022s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:41 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9f7ecc3f-b67d-4bcf-948c-d03bcf0941a3 1073741824" returned: 0 in 1.037s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:41 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db1f5d9-5475-4920-8f55-90c77f0f7ec7]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-54d5d298-a0e5-4e28-a2cd-e0982ba83097 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a81e60be-4649-458c-b674-48c61ca234e4 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9f7ecc3f-b67d-4bcf-948c-d03bcf0941a3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:41 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4563992-7257-471b-a651-8ccecd8ae81d_dzasy2r3devstack@QuobyteHD Jul 10 18:31:41 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:41 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9f7ecc3f-b67d-4bcf-948c-d03bcf0941a3 Jul 10 18:31:41 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:41 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-38e88be6-1a3a-45ae-92a2-6a7ef3ddd2c7 tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.779s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:41 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-38e88be6-1a3a-45ae-92a2-6a7ef3ddd2c7 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:31:41 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-38e88be6-1a3a-45ae-92a2-6a7ef3ddd2c7 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Deleted volume successfully. Jul 10 18:31:41 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-38e88be6-1a3a-45ae-92a2-6a7ef3ddd2c7 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "cinder-379df739-3baf-425e-bbb4-e2abc1d72145-delete_volume" released by "delete_volume" :: held 4.231s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:41 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a81e60be-4649-458c-b674-48c61ca234e4 Jul 10 18:31:41 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:41 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4563992-7257-471b-a651-8ccecd8ae81d_dzasy2r3devstack@QuobyteHD" returned: 0 in 0.813s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4563992-7257-471b-a651-8ccecd8ae81d_dzasy2r3devstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:41 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9f7ecc3f-b67d-4bcf-948c-d03bcf0941a3" returned: 0 in 0.766s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:41 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:31:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.194s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:41 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:31:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1196039707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acdb109f-92d2-413d-afad-b0db2eb6ce50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bdebbc27cc745e1a7d011316ca44ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:31:38Z,use_quota=True,user_id='a71ea1188e134470bdec99d18107bd26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:31:41 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Creating volume acdb109f-92d2-413d-afad-b0db2eb6ce50 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:31:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:41 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:41 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:41 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:31:41 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:31:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-acdb109f-92d2-413d-afad-b0db2eb6ce50 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:41 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4563992-7257-471b-a651-8ccecd8ae81d_dzasy2r3devstack@QuobyteHD Jul 10 18:31:41 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:41 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (412a8d6e-da6d-4218-aab7-00fefb38d5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f7ecc3f-b67d-4bcf-948c-d03bcf0941a3', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:41 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-acdb109f-92d2-413d-afad-b0db2eb6ce50 1073741824 Jul 10 18:31:41 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6db4a76c-9c42-451a-b43f-fe00a501f0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-54d5d298-a0e5-4e28-a2cd-e0982ba83097 tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a81e60be-4649-458c-b674-48c61ca234e4" returned: 0 in 0.877s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-54d5d298-a0e5-4e28-a2cd-e0982ba83097 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a81e60be-4649-458c-b674-48c61ca234e4 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:41 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Volume volume-9f7ecc3f-b67d-4bcf-948c-d03bcf0941a3 (9f7ecc3f-b67d-4bcf-948c-d03bcf0941a3): created successfully Jul 10 18:31:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6db4a76c-9c42-451a-b43f-fe00a501f0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:41 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Flow 'volume_create_manager' (2ec43352-5324-426b-81d1-41929de34e2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:31:41 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a81e60be-4649-458c-b674-48c61ca234e4 Jul 10 18:31:41 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:41 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-edcf4770-b79a-42dc-b953-52e3e06ea849 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Created volume successfully. Jul 10 18:31:42 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4563992-7257-471b-a651-8ccecd8ae81d_dzasy2r3devstack@QuobyteHD" returned: 1 in 0.763s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4563992-7257-471b-a651-8ccecd8ae81d_dzasy2r3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:31:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:42 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-54d5d298-a0e5-4e28-a2cd-e0982ba83097 tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a81e60be-4649-458c-b674-48c61ca234e4" returned: 0 in 0.782s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:42 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-54d5d298-a0e5-4e28-a2cd-e0982ba83097 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "cinder-quobyte-a81e60be-4649-458c-b674-48c61ca234e4" released by "delete_volume" :: held 1.722s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:42 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-54d5d298-a0e5-4e28-a2cd-e0982ba83097 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Created reservations ['8f3a1a48-b6d3-4dbc-a063-003924d65ec7', '425e424d-f5d3-4069-bc0c-89cc6c7485e3', '55b3b804-63fa-48f5-b58f-83c68d4a8d67', '365e1b00-1dee-4d72-bbf9-b1837b325ee4'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:31:42 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-acdb109f-92d2-413d-afad-b0db2eb6ce50 1073741824" returned: 0 in 0.935s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-54d5d298-a0e5-4e28-a2cd-e0982ba83097 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-54d5d298-a0e5-4e28-a2cd-e0982ba83097 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:42 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-54d5d298-a0e5-4e28-a2cd-e0982ba83097 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:42 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-54d5d298-a0e5-4e28-a2cd-e0982ba83097 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-54d5d298-a0e5-4e28-a2cd-e0982ba83097 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-54d5d298-a0e5-4e28-a2cd-e0982ba83097 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-acdb109f-92d2-413d-afad-b0db2eb6ce50 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:42 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:31:42 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:42 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-acdb109f-92d2-413d-afad-b0db2eb6ce50 Jul 10 18:31:42 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:43 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-13524a4e-27e8-415b-9b05-b39e0a79b34e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "cinder-3d414483-8922-49c3-883b-6381e8ef4e11-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:43 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-13524a4e-27e8-415b-9b05-b39e0a79b34e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "cinder-3d414483-8922-49c3-883b-6381e8ef4e11-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:43 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-13524a4e-27e8-415b-9b05-b39e0a79b34e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "cinder-quobyte-3d414483-8922-49c3-883b-6381e8ef4e11" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:43 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-13524a4e-27e8-415b-9b05-b39e0a79b34e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "cinder-quobyte-3d414483-8922-49c3-883b-6381e8ef4e11" acquired by "delete_volume" :: waited 0.023s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:43 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e341385-5ab3-4d06-915f-15f0ae1ce039]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-13524a4e-27e8-415b-9b05-b39e0a79b34e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3d414483-8922-49c3-883b-6381e8ef4e11 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:43 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3d414483-8922-49c3-883b-6381e8ef4e11 Jul 10 18:31:43 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:43 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-54d5d298-a0e5-4e28-a2cd-e0982ba83097 tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.736s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:43 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-54d5d298-a0e5-4e28-a2cd-e0982ba83097 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:31:43 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-54d5d298-a0e5-4e28-a2cd-e0982ba83097 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Deleted volume successfully. Jul 10 18:31:43 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-54d5d298-a0e5-4e28-a2cd-e0982ba83097 tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "cinder-a81e60be-4649-458c-b674-48c61ca234e4-delete_volume" released by "delete_volume" :: held 2.707s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:43 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-acdb109f-92d2-413d-afad-b0db2eb6ce50" returned: 0 in 0.759s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:43 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:31:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.242s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:43 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1893207630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4880529a-840c-46ad-9088-8222dcb46011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bdebbc27cc745e1a7d011316ca44ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:31:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:31:39Z,use_quota=True,user_id='a71ea1188e134470bdec99d18107bd26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:31:43 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Creating volume 4880529a-840c-46ad-9088-8222dcb46011 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:31:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:43 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:43 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:43 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:31:43 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:31:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4880529a-840c-46ad-9088-8222dcb46011 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce5f37c1-af3e-48a3-8cd6-e6c1a1c6afba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acdb109f-92d2-413d-afad-b0db2eb6ce50', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:43 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4880529a-840c-46ad-9088-8222dcb46011 1073741824 Jul 10 18:31:43 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb0047ec-ebe1-41f0-9d62-66ad0f15e908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:43 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Volume volume-acdb109f-92d2-413d-afad-b0db2eb6ce50 (acdb109f-92d2-413d-afad-b0db2eb6ce50): created successfully Jul 10 18:31:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb0047ec-ebe1-41f0-9d62-66ad0f15e908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:43 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Flow 'volume_create_manager' (453fb2b2-cfc5-43dd-a7e8-082cebaacc8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:31:43 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-b3e44afd-38ea-4633-89f4-d6d20440ac2d tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Created volume successfully. Jul 10 18:31:44 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-13524a4e-27e8-415b-9b05-b39e0a79b34e tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3d414483-8922-49c3-883b-6381e8ef4e11" returned: 0 in 0.824s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-13524a4e-27e8-415b-9b05-b39e0a79b34e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3d414483-8922-49c3-883b-6381e8ef4e11 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:44 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3d414483-8922-49c3-883b-6381e8ef4e11 Jul 10 18:31:44 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:44 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4880529a-840c-46ad-9088-8222dcb46011 1073741824" returned: 0 in 0.880s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4880529a-840c-46ad-9088-8222dcb46011 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:44 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4880529a-840c-46ad-9088-8222dcb46011 Jul 10 18:31:44 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:44 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-13524a4e-27e8-415b-9b05-b39e0a79b34e tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3d414483-8922-49c3-883b-6381e8ef4e11" returned: 0 in 0.689s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:44 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-13524a4e-27e8-415b-9b05-b39e0a79b34e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "cinder-quobyte-3d414483-8922-49c3-883b-6381e8ef4e11" released by "delete_volume" :: held 1.568s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:44 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-13524a4e-27e8-415b-9b05-b39e0a79b34e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Created reservations ['d29378f5-6fab-4bcf-90f1-e5644e1d39da', 'b16e3fde-3057-41fb-befd-530382334d75', '2a333977-7c8d-4ddc-9997-31b773cf4864', 'b033af44-f91f-4f2c-b766-08e9ab5d15c8'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:31:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-13524a4e-27e8-415b-9b05-b39e0a79b34e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-13524a4e-27e8-415b-9b05-b39e0a79b34e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:44 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-13524a4e-27e8-415b-9b05-b39e0a79b34e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:44 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-13524a4e-27e8-415b-9b05-b39e0a79b34e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-13524a4e-27e8-415b-9b05-b39e0a79b34e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-13524a4e-27e8-415b-9b05-b39e0a79b34e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:44 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:31:44 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:45 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4880529a-840c-46ad-9088-8222dcb46011" returned: 0 in 0.681s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:45 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:31:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.093s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:45 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:31:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1448524424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8ec4cd2-43d9-424e-a431-637a654d4b19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bdebbc27cc745e1a7d011316ca44ee7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:31:40Z,use_quota=True,user_id='a71ea1188e134470bdec99d18107bd26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:31:45 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Creating volume c8ec4cd2-43d9-424e-a431-637a654d4b19 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:31:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:45 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:45 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:45 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:31:45 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:31:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c8ec4cd2-43d9-424e-a431-637a654d4b19 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:45 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85b90ed8-77f6-44df-831f-506476523124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4880529a-840c-46ad-9088-8222dcb46011', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:45 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c8ec4cd2-43d9-424e-a431-637a654d4b19 1073741824 Jul 10 18:31:45 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:45 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (302a53c4-3e4f-45e7-a122-9ebb288344be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:45 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Volume volume-4880529a-840c-46ad-9088-8222dcb46011 (4880529a-840c-46ad-9088-8222dcb46011): created successfully Jul 10 18:31:45 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (302a53c4-3e4f-45e7-a122-9ebb288344be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:45 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Flow 'volume_create_manager' (e2805c68-78cf-4fc1-8026-2e5f8ce201e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:31:45 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-c81d5b71-8b47-4062-a7ca-5e9e2ddd1ef0 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Created volume successfully. Jul 10 18:31:45 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-54748fa1-e85d-4aeb-8d7b-918324f198ab tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "cinder-1d7817cd-462f-4abb-9f9c-80107a2a565d-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:45 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-54748fa1-e85d-4aeb-8d7b-918324f198ab tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "cinder-1d7817cd-462f-4abb-9f9c-80107a2a565d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:45 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-54748fa1-e85d-4aeb-8d7b-918324f198ab tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "cinder-quobyte-1d7817cd-462f-4abb-9f9c-80107a2a565d" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:45 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-54748fa1-e85d-4aeb-8d7b-918324f198ab tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "cinder-quobyte-1d7817cd-462f-4abb-9f9c-80107a2a565d" acquired by "delete_volume" :: waited 0.024s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:45 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcbdec1-b479-4042-9202-8d53f7417915]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-54748fa1-e85d-4aeb-8d7b-918324f198ab tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1d7817cd-462f-4abb-9f9c-80107a2a565d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:45 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1d7817cd-462f-4abb-9f9c-80107a2a565d Jul 10 18:31:45 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:45 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-13524a4e-27e8-415b-9b05-b39e0a79b34e tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.785s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:45 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-13524a4e-27e8-415b-9b05-b39e0a79b34e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:31:45 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-13524a4e-27e8-415b-9b05-b39e0a79b34e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Deleted volume successfully. Jul 10 18:31:45 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-13524a4e-27e8-415b-9b05-b39e0a79b34e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "cinder-3d414483-8922-49c3-883b-6381e8ef4e11-delete_volume" released by "delete_volume" :: held 2.594s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:46 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c8ec4cd2-43d9-424e-a431-637a654d4b19 1073741824" returned: 0 in 0.874s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c8ec4cd2-43d9-424e-a431-637a654d4b19 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:46 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c8ec4cd2-43d9-424e-a431-637a654d4b19 Jul 10 18:31:46 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:46 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-54748fa1-e85d-4aeb-8d7b-918324f198ab tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1d7817cd-462f-4abb-9f9c-80107a2a565d" returned: 0 in 0.803s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-54748fa1-e85d-4aeb-8d7b-918324f198ab tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1d7817cd-462f-4abb-9f9c-80107a2a565d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:46 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1d7817cd-462f-4abb-9f9c-80107a2a565d Jul 10 18:31:46 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:46 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c8ec4cd2-43d9-424e-a431-637a654d4b19" returned: 0 in 0.654s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:46 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:31:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.350s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:46 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-435637149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b58c1644-3cd8-4544-8412-2724bede6747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='935a1657e6614ac3a2269f04e097247e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:31:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:31:40Z,use_quota=True,user_id='bf797658fda948239bec7f0bcb759bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:31:46 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] Creating volume b58c1644-3cd8-4544-8412-2724bede6747 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:31:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:46 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:46 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:46 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:31:46 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:31:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:46 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747 1073741824 Jul 10 18:31:46 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd9be3b9-03c4-47b7-9bc5-46dde294f3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8ec4cd2-43d9-424e-a431-637a654d4b19', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (104e3e98-9eb4-4857-9297-8fab168f7c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:46 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Volume volume-c8ec4cd2-43d9-424e-a431-637a654d4b19 (c8ec4cd2-43d9-424e-a431-637a654d4b19): created successfully Jul 10 18:31:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (104e3e98-9eb4-4857-9297-8fab168f7c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Flow 'volume_create_manager' (5168197e-af1b-47cc-ac6c-35ad6b996a71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:31:46 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-6070e1eb-2fb2-4c05-832e-b1d964070089 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Created volume successfully. Jul 10 18:31:47 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-54748fa1-e85d-4aeb-8d7b-918324f198ab tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1d7817cd-462f-4abb-9f9c-80107a2a565d" returned: 0 in 0.696s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:47 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-54748fa1-e85d-4aeb-8d7b-918324f198ab tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "cinder-quobyte-1d7817cd-462f-4abb-9f9c-80107a2a565d" released by "delete_volume" :: held 1.544s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:47 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-54748fa1-e85d-4aeb-8d7b-918324f198ab tempest-CreateVolumesFromSnapshotTest-2132304058 None] Created reservations ['077316b6-f016-4fc7-9489-d3b6bdc31f85', '3640f113-8a50-42eb-bf77-cfde7a0359ac', 'd24577f8-e897-4d15-97fe-a2ce7c59cfa2', '6107cff1-d0c3-4aa2-8922-f7dc5dd7a410'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:31:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-54748fa1-e85d-4aeb-8d7b-918324f198ab tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-54748fa1-e85d-4aeb-8d7b-918324f198ab tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-54748fa1-e85d-4aeb-8d7b-918324f198ab tempest-CreateVolumesFromSnapshotTest-2132304058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-54748fa1-e85d-4aeb-8d7b-918324f198ab tempest-CreateVolumesFromSnapshotTest-2132304058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-54748fa1-e85d-4aeb-8d7b-918324f198ab tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-54748fa1-e85d-4aeb-8d7b-918324f198ab tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:47 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:31:47 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:47 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747 1073741824" returned: 0 in 0.807s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:47 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-16bae4f9-76f1-48a0-9601-ca21c18cd94e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "cinder-ba50b409-f2c3-4839-b42e-cfcaf9bd5d45-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:47 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-16bae4f9-76f1-48a0-9601-ca21c18cd94e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "cinder-ba50b409-f2c3-4839-b42e-cfcaf9bd5d45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:47 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-16bae4f9-76f1-48a0-9601-ca21c18cd94e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "cinder-quobyte-9720671c-641a-49c2-acb0-a3c502a61d93" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:47 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-16bae4f9-76f1-48a0-9601-ca21c18cd94e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "cinder-quobyte-9720671c-641a-49c2-acb0-a3c502a61d93" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:47 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-16bae4f9-76f1-48a0-9601-ca21c18cd94e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "cinder-quobyte-ba50b409-f2c3-4839-b42e-cfcaf9bd5d45" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:47 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747 Jul 10 18:31:47 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:47 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-16bae4f9-76f1-48a0-9601-ca21c18cd94e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "cinder-quobyte-ba50b409-f2c3-4839-b42e-cfcaf9bd5d45" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-16bae4f9-76f1-48a0-9601-ca21c18cd94e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Deleting offline snapshot ba50b409-f2c3-4839-b42e-cfcaf9bd5d45 of volume 9720671c-641a-49c2-acb0-a3c502a61d93 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:31:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-16bae4f9-76f1-48a0-9601-ca21c18cd94e tempest-CreateVolumesFromSnapshotTest-2132304058 None] snapshot_file for this snap is: volume-9720671c-641a-49c2-acb0-a3c502a61d93.ba50b409-f2c3-4839-b42e-cfcaf9bd5d45 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:31:47 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-afe6c134-6600-4922-a998-86939c20b6aa tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Acquiring lock "cinder-c8ec4cd2-43d9-424e-a431-637a654d4b19-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:47 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[462eaa12-ca33-48d0-9b45-178eecd348f0]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-16bae4f9-76f1-48a0-9601-ca21c18cd94e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93.ba50b409-f2c3-4839-b42e-cfcaf9bd5d45 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:47 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:47 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-afe6c134-6600-4922-a998-86939c20b6aa tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "cinder-c8ec4cd2-43d9-424e-a431-637a654d4b19-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-54748fa1-e85d-4aeb-8d7b-918324f198ab tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.734s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:47 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-54748fa1-e85d-4aeb-8d7b-918324f198ab tempest-CreateVolumesFromSnapshotTest-2132304058 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:31:47 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-54748fa1-e85d-4aeb-8d7b-918324f198ab tempest-CreateVolumesFromSnapshotTest-2132304058 None] Deleted volume successfully. Jul 10 18:31:47 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-afe6c134-6600-4922-a998-86939c20b6aa tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Acquiring lock "cinder-quobyte-c8ec4cd2-43d9-424e-a431-637a654d4b19" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:47 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-54748fa1-e85d-4aeb-8d7b-918324f198ab tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "cinder-1d7817cd-462f-4abb-9f9c-80107a2a565d-delete_volume" released by "delete_volume" :: held 2.520s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:47 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-afe6c134-6600-4922-a998-86939c20b6aa tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "cinder-quobyte-c8ec4cd2-43d9-424e-a431-637a654d4b19" acquired by "delete_volume" :: waited 0.024s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:48 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[83846e7a-7d00-4924-92f8-494312459e87]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-afe6c134-6600-4922-a998-86939c20b6aa tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c8ec4cd2-43d9-424e-a431-637a654d4b19 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:48 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93.ba50b409-f2c3-4839-b42e-cfcaf9bd5d45 Jul 10 18:31:48 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:48 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c8ec4cd2-43d9-424e-a431-637a654d4b19 Jul 10 18:31:48 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:48 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747" returned: 0 in 0.708s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:48 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:31:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.931s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:48 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b1dfdd-5349-4ec3-bab7-426e5242d447,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cda813ed52974cf48682a9934f78d3e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:31:37Z,use_quota=True,user_id='8f3f40d8ff8d4971b54f04cae6841379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:31:48 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Creating volume 15b1dfdd-5349-4ec3-bab7-426e5242d447 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:31:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:48 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:48 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:48 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:31:48 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:31:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-15b1dfdd-5349-4ec3-bab7-426e5242d447 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:48 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-15b1dfdd-5349-4ec3-bab7-426e5242d447 1073741824 Jul 10 18:31:48 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (815ef3d8-bb73-459e-b29b-a5aefdf708dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b58c1644-3cd8-4544-8412-2724bede6747', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99dca4b5-b012-4808-90d1-15b258e2feaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:48 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] Volume volume-b58c1644-3cd8-4544-8412-2724bede6747 (b58c1644-3cd8-4544-8412-2724bede6747): created successfully Jul 10 18:31:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99dca4b5-b012-4808-90d1-15b258e2feaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] Flow 'volume_create_manager' (fbf60292-be98-4f42-be69-639f51e5644b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:31:48 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-6a78596a-2bd4-4cb6-8a2d-fe0b3b7f9e6a tempest-ProjectReaderTests-1682954090 None] Created volume successfully. Jul 10 18:31:48 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-16bae4f9-76f1-48a0-9601-ca21c18cd94e tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93.ba50b409-f2c3-4839-b42e-cfcaf9bd5d45" returned: 0 in 0.872s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:48 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-16bae4f9-76f1-48a0-9601-ca21c18cd94e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9720671c-641a-49c2-acb0-a3c502a61d93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:31:48 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6907331-0aeb-4b02-a08d-9f89c9f22808]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-16bae4f9-76f1-48a0-9601-ca21c18cd94e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:48 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-afe6c134-6600-4922-a998-86939c20b6aa tempest-CreateVolumesFromSourceVolumeTest-272723535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c8ec4cd2-43d9-424e-a431-637a654d4b19" returned: 0 in 0.815s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-afe6c134-6600-4922-a998-86939c20b6aa tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c8ec4cd2-43d9-424e-a431-637a654d4b19 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:48 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c8ec4cd2-43d9-424e-a431-637a654d4b19 Jul 10 18:31:48 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:48 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93 Jul 10 18:31:48 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8184ad0d-266f-40a1-ae8f-30f78ed622f1 tempest-ProjectReaderTests-1682954090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:49 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-15b1dfdd-5349-4ec3-bab7-426e5242d447 1073741824" returned: 0 in 0.980s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-15b1dfdd-5349-4ec3-bab7-426e5242d447 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:49 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-15b1dfdd-5349-4ec3-bab7-426e5242d447 Jul 10 18:31:49 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:49 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-afe6c134-6600-4922-a998-86939c20b6aa tempest-CreateVolumesFromSourceVolumeTest-272723535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-c8ec4cd2-43d9-424e-a431-637a654d4b19" returned: 0 in 0.734s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:49 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-afe6c134-6600-4922-a998-86939c20b6aa tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "cinder-quobyte-c8ec4cd2-43d9-424e-a431-637a654d4b19" released by "delete_volume" :: held 1.591s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:49 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-afe6c134-6600-4922-a998-86939c20b6aa tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Created reservations ['af513fe6-56b2-4963-99cc-ab982156363d', 'adc78714-ae72-4dac-a639-763f2db44139', '5011b91c-86fa-4367-90d2-f163b1f9d3d0', '9c6e05bb-6338-40f6-b95e-e7c29b57bf8f'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:31:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-afe6c134-6600-4922-a998-86939c20b6aa tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-afe6c134-6600-4922-a998-86939c20b6aa tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:49 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-afe6c134-6600-4922-a998-86939c20b6aa tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:49 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-afe6c134-6600-4922-a998-86939c20b6aa tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-afe6c134-6600-4922-a998-86939c20b6aa tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-afe6c134-6600-4922-a998-86939c20b6aa tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:49 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-16bae4f9-76f1-48a0-9601-ca21c18cd94e tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93" returned: 0 in 0.944s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-16bae4f9-76f1-48a0-9601-ca21c18cd94e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93.ba50b409-f2c3-4839-b42e-cfcaf9bd5d45 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:49 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:31:49 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:49 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93.ba50b409-f2c3-4839-b42e-cfcaf9bd5d45 Jul 10 18:31:49 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:50 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3ee35d34-14c3-47bb-ae06-b1a524ee566b tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Acquiring lock "cinder-4880529a-840c-46ad-9088-8222dcb46011-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:50 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3ee35d34-14c3-47bb-ae06-b1a524ee566b tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "cinder-4880529a-840c-46ad-9088-8222dcb46011-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:50 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3ee35d34-14c3-47bb-ae06-b1a524ee566b tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Acquiring lock "cinder-quobyte-4880529a-840c-46ad-9088-8222dcb46011" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:50 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3ee35d34-14c3-47bb-ae06-b1a524ee566b tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "cinder-quobyte-4880529a-840c-46ad-9088-8222dcb46011" acquired by "delete_volume" :: waited 0.029s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:50 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b7dc2d-2e8d-4257-851a-5c0a43fe002a]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3ee35d34-14c3-47bb-ae06-b1a524ee566b tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4880529a-840c-46ad-9088-8222dcb46011 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:50 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-15b1dfdd-5349-4ec3-bab7-426e5242d447" returned: 0 in 0.876s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:50 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] <== create_volume: return (1896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:31:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.901s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8184ad0d-266f-40a1-ae8f-30f78ed622f1 tempest-ProjectReaderTests-1682954090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.117s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:50 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:50 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-8184ad0d-266f-40a1-ae8f-30f78ed622f1 tempest-ProjectReaderTests-1682954090 None] Creating offline snapshot 263a1e66-d490-4796-98cd-7b7e6f380611 of volume b58c1644-3cd8-4544-8412-2724bede6747 {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:31:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-afe6c134-6600-4922-a998-86939c20b6aa tempest-CreateVolumesFromSourceVolumeTest-272723535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.707s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:50 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-afe6c134-6600-4922-a998-86939c20b6aa tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:31:50 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-afe6c134-6600-4922-a998-86939c20b6aa tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Deleted volume successfully. Jul 10 18:31:50 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cef017-c9f8-4339-acd1-69491c03a9ea]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8184ad0d-266f-40a1-ae8f-30f78ed622f1 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:50 devstack cinder-volume[87399]: DEBUG cinder.volume.volume_utils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Attempting download of b4563992-7257-471b-a651-8ccecd8ae81d ((None, [{'url': 'file:///opt/stack/data/glance/images/b4563992-7257-471b-a651-8ccecd8ae81d', 'metadata': {}}])) to volume 15b1dfdd-5349-4ec3-bab7-426e5242d447. {{(pid=87399) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 18:31:50 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4880529a-840c-46ad-9088-8222dcb46011 Jul 10 18:31:50 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:50 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-afe6c134-6600-4922-a998-86939c20b6aa tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "cinder-c8ec4cd2-43d9-424e-a431-637a654d4b19-delete_volume" released by "delete_volume" :: held 2.589s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:50 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8288d6-0435-4dba-8989-885de7c1f013]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4563992-7257-471b-a651-8ccecd8ae81d_iunq4hpt {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:50 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747 Jul 10 18:31:50 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:50 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-16bae4f9-76f1-48a0-9601-ca21c18cd94e tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93.ba50b409-f2c3-4839-b42e-cfcaf9bd5d45" returned: 0 in 0.889s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-16bae4f9-76f1-48a0-9601-ca21c18cd94e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93.ba50b409-f2c3-4839-b42e-cfcaf9bd5d45 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:50 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93.ba50b409-f2c3-4839-b42e-cfcaf9bd5d45 Jul 10 18:31:50 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:50 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4563992-7257-471b-a651-8ccecd8ae81d_iunq4hpt Jul 10 18:31:50 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:51 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3ee35d34-14c3-47bb-ae06-b1a524ee566b tempest-CreateVolumesFromSourceVolumeTest-272723535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4880529a-840c-46ad-9088-8222dcb46011" returned: 0 in 0.849s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3ee35d34-14c3-47bb-ae06-b1a524ee566b tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4880529a-840c-46ad-9088-8222dcb46011 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:51 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4880529a-840c-46ad-9088-8222dcb46011 Jul 10 18:31:51 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:51 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-16bae4f9-76f1-48a0-9601-ca21c18cd94e tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93.ba50b409-f2c3-4839-b42e-cfcaf9bd5d45" returned: 0 in 0.695s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:51 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=135,cinder:UPDATE=187,cinder:INSERT=51,cinder:DELETE=21 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:31:51 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:UPDATE=189,cinder:SELECT=140,cinder:DELETE=16,cinder:INSERT=43 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:31:51 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8184ad0d-266f-40a1-ae8f-30f78ed622f1 tempest-ProjectReaderTests-1682954090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747" returned: 0 in 0.943s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8184ad0d-266f-40a1-ae8f-30f78ed622f1 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747.263a1e66-d490-4796-98cd-7b7e6f380611 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:51 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-16bae4f9-76f1-48a0-9601-ca21c18cd94e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "cinder-quobyte-ba50b409-f2c3-4839-b42e-cfcaf9bd5d45" released by "_delete_snapshot" :: held 3.589s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:51 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:51 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747.263a1e66-d490-4796-98cd-7b7e6f380611 1G Jul 10 18:31:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b4563992-7257-471b-a651-8ccecd8ae81d_iunq4hpt" returned: 0 in 0.865s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:51 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4563992-7257-471b-a651-8ccecd8ae81d_iunq4hpt {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:51 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-16bae4f9-76f1-48a0-9601-ca21c18cd94e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "cinder-quobyte-9720671c-641a-49c2-acb0-a3c502a61d93" released by "delete_snapshot" :: held 3.657s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:51 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4563992-7257-471b-a651-8ccecd8ae81d_iunq4hpt Jul 10 18:31:51 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-16bae4f9-76f1-48a0-9601-ca21c18cd94e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Created reservations ['d1d80599-19cc-41ff-8804-aa27ec7594e3', 'dbe22d4f-83b3-493a-9ef8-8570ee74698c', '1f60f363-1025-4ebe-828b-42439dbdf12b', '4a7b31e0-cf31-4146-87b2-db8bb7d8b7d4'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:31:51 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:51 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-16bae4f9-76f1-48a0-9601-ca21c18cd94e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Delete snapshot completed successfully. Jul 10 18:31:51 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-16bae4f9-76f1-48a0-9601-ca21c18cd94e tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "cinder-ba50b409-f2c3-4839-b42e-cfcaf9bd5d45-delete_snapshot" released by "delete_snapshot" :: held 3.980s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-99dda88d-7f91-4cf5-9ec0-58223de7124a tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "cinder-9720671c-641a-49c2-acb0-a3c502a61d93-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-99dda88d-7f91-4cf5-9ec0-58223de7124a tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "cinder-9720671c-641a-49c2-acb0-a3c502a61d93-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-99dda88d-7f91-4cf5-9ec0-58223de7124a tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "cinder-quobyte-9720671c-641a-49c2-acb0-a3c502a61d93" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-99dda88d-7f91-4cf5-9ec0-58223de7124a tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "cinder-quobyte-9720671c-641a-49c2-acb0-a3c502a61d93" acquired by "delete_volume" :: waited 0.025s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:52 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:52 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[4626d2c1-dfaa-4517-a2d2-8edbea42880b]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-99dda88d-7f91-4cf5-9ec0-58223de7124a tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3ee35d34-14c3-47bb-ae06-b1a524ee566b tempest-CreateVolumesFromSourceVolumeTest-272723535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4880529a-840c-46ad-9088-8222dcb46011" returned: 0 in 1.028s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3ee35d34-14c3-47bb-ae06-b1a524ee566b tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "cinder-quobyte-4880529a-840c-46ad-9088-8222dcb46011" released by "delete_volume" :: held 1.934s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:52 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-3ee35d34-14c3-47bb-ae06-b1a524ee566b tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Created reservations ['797c8cab-1eb3-4856-b151-9680a1859efc', '1aca8383-aae5-4fe9-803a-2481cfbab9de', '37eec704-e2db-4ee7-ad07-7dbce225f014', 'b658ff83-f87e-4dd0-b106-7fd93981f651'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:31:52 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93 Jul 10 18:31:52 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3ee35d34-14c3-47bb-ae06-b1a524ee566b tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3ee35d34-14c3-47bb-ae06-b1a524ee566b tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:52 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-3ee35d34-14c3-47bb-ae06-b1a524ee566b tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:52 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-3ee35d34-14c3-47bb-ae06-b1a524ee566b tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3ee35d34-14c3-47bb-ae06-b1a524ee566b tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3ee35d34-14c3-47bb-ae06-b1a524ee566b tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:52 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8184ad0d-266f-40a1-ae8f-30f78ed622f1 tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747.263a1e66-d490-4796-98cd-7b7e6f380611 1G" returned: 0 in 1.090s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8184ad0d-266f-40a1-ae8f-30f78ed622f1 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b58c1644-3cd8-4544-8412-2724bede6747 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747.263a1e66-d490-4796-98cd-7b7e6f380611 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:52 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:52 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:31:52 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4563992-7257-471b-a651-8ccecd8ae81d_iunq4hpt" returned: 1 in 1.087s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b4563992-7257-471b-a651-8ccecd8ae81d_iunq4hpt' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:31:52 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad5411d-f372-4753-a297-49200e4e3043]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4563992-7257-471b-a651-8ccecd8ae81d_dzasy2r3devstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:52 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b58c1644-3cd8-4544-8412-2724bede6747 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747.263a1e66-d490-4796-98cd-7b7e6f380611 Jul 10 18:31:52 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e3c098de-ec8b-4722-8cfb-4626fc186245 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Acquiring lock "cinder-acdb109f-92d2-413d-afad-b0db2eb6ce50-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e3c098de-ec8b-4722-8cfb-4626fc186245 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "cinder-acdb109f-92d2-413d-afad-b0db2eb6ce50-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e3c098de-ec8b-4722-8cfb-4626fc186245 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Acquiring lock "cinder-quobyte-acdb109f-92d2-413d-afad-b0db2eb6ce50" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e3c098de-ec8b-4722-8cfb-4626fc186245 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "cinder-quobyte-acdb109f-92d2-413d-afad-b0db2eb6ce50" acquired by "delete_volume" :: waited 0.035s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:52 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4563992-7257-471b-a651-8ccecd8ae81d_dzasy2r3devstack@QuobyteHD Jul 10 18:31:52 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:52 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[37523f4c-20d7-44d3-a354-2eec83fbebda]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e3c098de-ec8b-4722-8cfb-4626fc186245 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-acdb109f-92d2-413d-afad-b0db2eb6ce50 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:52 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-acdb109f-92d2-413d-afad-b0db2eb6ce50 Jul 10 18:31:52 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:53 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3ee35d34-14c3-47bb-ae06-b1a524ee566b tempest-CreateVolumesFromSourceVolumeTest-272723535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.036s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:53 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-3ee35d34-14c3-47bb-ae06-b1a524ee566b tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:31:53 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-3ee35d34-14c3-47bb-ae06-b1a524ee566b tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Deleted volume successfully. Jul 10 18:31:53 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-99dda88d-7f91-4cf5-9ec0-58223de7124a tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93" returned: 0 in 1.304s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-99dda88d-7f91-4cf5-9ec0-58223de7124a tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:53 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3ee35d34-14c3-47bb-ae06-b1a524ee566b tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "cinder-4880529a-840c-46ad-9088-8222dcb46011-delete_volume" released by "delete_volume" :: held 3.373s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:53 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93 Jul 10 18:31:53 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:53 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8184ad0d-266f-40a1-ae8f-30f78ed622f1 tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b58c1644-3cd8-4544-8412-2724bede6747 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747.263a1e66-d490-4796-98cd-7b7e6f380611" returned: 0 in 1.132s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:53 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-8184ad0d-266f-40a1-ae8f-30f78ed622f1 tempest-ProjectReaderTests-1682954090 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747.263a1e66-d490-4796-98cd-7b7e6f380611 is being set with open permissions: ugo+rw Jul 10 18:31:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8184ad0d-266f-40a1-ae8f-30f78ed622f1 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747.263a1e66-d490-4796-98cd-7b7e6f380611 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:53 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747.263a1e66-d490-4796-98cd-7b7e6f380611 Jul 10 18:31:53 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:53 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e3c098de-ec8b-4722-8cfb-4626fc186245 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-acdb109f-92d2-413d-afad-b0db2eb6ce50" returned: 0 in 0.926s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e3c098de-ec8b-4722-8cfb-4626fc186245 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-acdb109f-92d2-413d-afad-b0db2eb6ce50 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:53 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b4563992-7257-471b-a651-8ccecd8ae81d_dzasy2r3devstack@QuobyteHD" returned: 0 in 1.174s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4563992-7257-471b-a651-8ccecd8ae81d_dzasy2r3devstack@QuobyteHD {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:53 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-acdb109f-92d2-413d-afad-b0db2eb6ce50 Jul 10 18:31:53 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:53 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4563992-7257-471b-a651-8ccecd8ae81d_dzasy2r3devstack@QuobyteHD Jul 10 18:31:53 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:54 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-99dda88d-7f91-4cf5-9ec0-58223de7124a tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9720671c-641a-49c2-acb0-a3c502a61d93" returned: 0 in 0.763s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:54 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-99dda88d-7f91-4cf5-9ec0-58223de7124a tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "cinder-quobyte-9720671c-641a-49c2-acb0-a3c502a61d93" released by "delete_volume" :: held 2.154s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:54 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:54 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-99dda88d-7f91-4cf5-9ec0-58223de7124a tempest-CreateVolumesFromSnapshotTest-2132304058 None] Created reservations ['4654f891-6624-4014-8f65-d11f99b7d3b0', 'b2aed438-7f1c-451d-9278-d707e484d96c', '4ef9eb20-efdc-4482-8aea-0a9757f3da73', '24a6d824-1e9d-4417-a4d0-37fc4100ab96'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:31:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8184ad0d-266f-40a1-ae8f-30f78ed622f1 tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747.263a1e66-d490-4796-98cd-7b7e6f380611" returned: 0 in 0.767s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:54 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8184ad0d-266f-40a1-ae8f-30f78ed622f1 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e3c098de-ec8b-4722-8cfb-4626fc186245 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-acdb109f-92d2-413d-afad-b0db2eb6ce50" returned: 0 in 0.764s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:54 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747.info Jul 10 18:31:54 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:54 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e3c098de-ec8b-4722-8cfb-4626fc186245 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "cinder-quobyte-acdb109f-92d2-413d-afad-b0db2eb6ce50" released by "delete_volume" :: held 1.768s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-99dda88d-7f91-4cf5-9ec0-58223de7124a tempest-CreateVolumesFromSnapshotTest-2132304058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-99dda88d-7f91-4cf5-9ec0-58223de7124a tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:54 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-99dda88d-7f91-4cf5-9ec0-58223de7124a tempest-CreateVolumesFromSnapshotTest-2132304058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:54 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-99dda88d-7f91-4cf5-9ec0-58223de7124a tempest-CreateVolumesFromSnapshotTest-2132304058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-99dda88d-7f91-4cf5-9ec0-58223de7124a tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-99dda88d-7f91-4cf5-9ec0-58223de7124a tempest-CreateVolumesFromSnapshotTest-2132304058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:54 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-e3c098de-ec8b-4722-8cfb-4626fc186245 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Created reservations ['5777800f-a593-4e37-bb95-c97bba637a42', '6498d770-e262-4e11-81d2-63a6ad4b5552', '363a6714-235a-4baa-b9ef-2346d52ca2fc', '08e674e0-a955-4f46-aaaa-fe0b1468ba06'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:31:54 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:31:54 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:54 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4563992-7257-471b-a651-8ccecd8ae81d_dzasy2r3devstack@QuobyteHD" returned: 1 in 0.895s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b4563992-7257-471b-a651-8ccecd8ae81d_dzasy2r3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:31:54 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] b4563992-7257-471b-a651-8ccecd8ae81d was raw, converting to raw {{(pid=87399) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 10 18:31:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b4563992-7257-471b-a651-8ccecd8ae81d_dzasy2r3devstack@QuobyteHD /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-15b1dfdd-5349-4ec3-bab7-426e5242d447 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:54 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b4563992-7257-471b-a651-8ccecd8ae81d_dzasy2r3devstack@QuobyteHD /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-15b1dfdd-5349-4ec3-bab7-426e5242d447 Jul 10 18:31:54 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e3c098de-ec8b-4722-8cfb-4626fc186245 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e3c098de-ec8b-4722-8cfb-4626fc186245 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:54 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e3c098de-ec8b-4722-8cfb-4626fc186245 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:54 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e3c098de-ec8b-4722-8cfb-4626fc186245 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e3c098de-ec8b-4722-8cfb-4626fc186245 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e3c098de-ec8b-4722-8cfb-4626fc186245 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:54 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:31:54 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2b6fcc44-d81a-4f85-baa9-6b127ffb2492 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Acquiring lock "cinder-9f7ecc3f-b67d-4bcf-948c-d03bcf0941a3-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2b6fcc44-d81a-4f85-baa9-6b127ffb2492 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "cinder-9f7ecc3f-b67d-4bcf-948c-d03bcf0941a3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2b6fcc44-d81a-4f85-baa9-6b127ffb2492 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Acquiring lock "cinder-quobyte-9f7ecc3f-b67d-4bcf-948c-d03bcf0941a3" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2b6fcc44-d81a-4f85-baa9-6b127ffb2492 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "cinder-quobyte-9f7ecc3f-b67d-4bcf-948c-d03bcf0941a3" acquired by "delete_volume" :: waited 0.029s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:55 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6babbc9-6cad-4639-99a1-8668e6b765be]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2b6fcc44-d81a-4f85-baa9-6b127ffb2492 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9f7ecc3f-b67d-4bcf-948c-d03bcf0941a3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:55 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8184ad0d-266f-40a1-ae8f-30f78ed622f1 tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747.info" returned: 0 in 0.815s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:55 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-8184ad0d-266f-40a1-ae8f-30f78ed622f1 tempest-ProjectReaderTests-1682954090 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747.info is being set with open permissions: ugo+rw Jul 10 18:31:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8184ad0d-266f-40a1-ae8f-30f78ed622f1 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:55 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747.info Jul 10 18:31:55 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:55 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-99dda88d-7f91-4cf5-9ec0-58223de7124a tempest-CreateVolumesFromSnapshotTest-2132304058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.801s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:55 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-99dda88d-7f91-4cf5-9ec0-58223de7124a tempest-CreateVolumesFromSnapshotTest-2132304058 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:31:55 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-99dda88d-7f91-4cf5-9ec0-58223de7124a tempest-CreateVolumesFromSnapshotTest-2132304058 None] Deleted volume successfully. Jul 10 18:31:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-99dda88d-7f91-4cf5-9ec0-58223de7124a tempest-CreateVolumesFromSnapshotTest-2132304058 None] Lock "cinder-9720671c-641a-49c2-acb0-a3c502a61d93-delete_volume" released by "delete_volume" :: held 3.319s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:55 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9f7ecc3f-b67d-4bcf-948c-d03bcf0941a3 Jul 10 18:31:55 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:55 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e3c098de-ec8b-4722-8cfb-4626fc186245 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.869s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:55 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-e3c098de-ec8b-4722-8cfb-4626fc186245 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:31:55 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-e3c098de-ec8b-4722-8cfb-4626fc186245 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Deleted volume successfully. Jul 10 18:31:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e3c098de-ec8b-4722-8cfb-4626fc186245 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "cinder-acdb109f-92d2-413d-afad-b0db2eb6ce50-delete_volume" released by "delete_volume" :: held 2.992s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:55 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b4563992-7257-471b-a651-8ccecd8ae81d_dzasy2r3devstack@QuobyteHD /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-15b1dfdd-5349-4ec3-bab7-426e5242d447" returned: 0 in 1.200s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:55 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b4563992-7257-471b-a651-8ccecd8ae81d_dzasy2r3devstack@QuobyteHD, size 0.00 MB, duration 1.20 sec, destination /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-15b1dfdd-5349-4ec3-bab7-426e5242d447 {{(pid=87399) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 18:31:55 devstack cinder-volume[87399]: INFO cinder.image.image_utils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 18:31:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-15b1dfdd-5349-4ec3-bab7-426e5242d447 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:55 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-15b1dfdd-5349-4ec3-bab7-426e5242d447 1G Jul 10 18:31:55 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:55 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8184ad0d-266f-40a1-ae8f-30f78ed622f1 tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747.info" returned: 0 in 0.747s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8184ad0d-266f-40a1-ae8f-30f78ed622f1 tempest-ProjectReaderTests-1682954090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.618s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:56 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-8184ad0d-266f-40a1-ae8f-30f78ed622f1 tempest-ProjectReaderTests-1682954090 None] Create snapshot completed successfully Jul 10 18:31:56 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2b6fcc44-d81a-4f85-baa9-6b127ffb2492 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9f7ecc3f-b67d-4bcf-948c-d03bcf0941a3" returned: 0 in 1.071s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2b6fcc44-d81a-4f85-baa9-6b127ffb2492 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9f7ecc3f-b67d-4bcf-948c-d03bcf0941a3 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:56 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9f7ecc3f-b67d-4bcf-948c-d03bcf0941a3 Jul 10 18:31:56 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:56 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-15b1dfdd-5349-4ec3-bab7-426e5242d447 1G" returned: 0 in 0.831s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:56 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[d149b20a-f4e9-4ab3-9a53-4b654d6aa9ae]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-15b1dfdd-5349-4ec3-bab7-426e5242d447 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:56 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-15b1dfdd-5349-4ec3-bab7-426e5242d447 Jul 10 18:31:56 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:56 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:56 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8919ca77-2cd8-406e-904f-abc9e17f0a48 tempest-ProjectReaderTests-1682954090 None] Acquiring lock "cinder-263a1e66-d490-4796-98cd-7b7e6f380611-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2b6fcc44-d81a-4f85-baa9-6b127ffb2492 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9f7ecc3f-b67d-4bcf-948c-d03bcf0941a3" returned: 0 in 0.712s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8919ca77-2cd8-406e-904f-abc9e17f0a48 tempest-ProjectReaderTests-1682954090 None] Lock "cinder-263a1e66-d490-4796-98cd-7b7e6f380611-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8919ca77-2cd8-406e-904f-abc9e17f0a48 tempest-ProjectReaderTests-1682954090 None] Acquiring lock "cinder-quobyte-b58c1644-3cd8-4544-8412-2724bede6747" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2b6fcc44-d81a-4f85-baa9-6b127ffb2492 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "cinder-quobyte-9f7ecc3f-b67d-4bcf-948c-d03bcf0941a3" released by "delete_volume" :: held 1.863s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8919ca77-2cd8-406e-904f-abc9e17f0a48 tempest-ProjectReaderTests-1682954090 None] Lock "cinder-quobyte-b58c1644-3cd8-4544-8412-2724bede6747" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8919ca77-2cd8-406e-904f-abc9e17f0a48 tempest-ProjectReaderTests-1682954090 None] Acquiring lock "cinder-quobyte-263a1e66-d490-4796-98cd-7b7e6f380611" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8919ca77-2cd8-406e-904f-abc9e17f0a48 tempest-ProjectReaderTests-1682954090 None] Lock "cinder-quobyte-263a1e66-d490-4796-98cd-7b7e6f380611" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-8919ca77-2cd8-406e-904f-abc9e17f0a48 tempest-ProjectReaderTests-1682954090 None] Deleting offline snapshot 263a1e66-d490-4796-98cd-7b7e6f380611 of volume b58c1644-3cd8-4544-8412-2724bede6747 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:31:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-8919ca77-2cd8-406e-904f-abc9e17f0a48 tempest-ProjectReaderTests-1682954090 None] snapshot_file for this snap is: volume-b58c1644-3cd8-4544-8412-2724bede6747.263a1e66-d490-4796-98cd-7b7e6f380611 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:31:57 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-2b6fcc44-d81a-4f85-baa9-6b127ffb2492 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Created reservations ['5fa6e565-f2b6-42a9-b620-e069ad4ea85d', 'b8ed623f-c0d9-48c5-b62d-d2ade3e457a2', '46abd107-8a06-4c97-9c8d-fbce541e5d37', '1ae5a8a5-4761-4dc3-9f07-6bf7f77ddfa2'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:31:57 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff2f3c1-8869-40bf-bbac-3d4979536e68]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8919ca77-2cd8-406e-904f-abc9e17f0a48 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747.263a1e66-d490-4796-98cd-7b7e6f380611 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2b6fcc44-d81a-4f85-baa9-6b127ffb2492 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2b6fcc44-d81a-4f85-baa9-6b127ffb2492 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-2b6fcc44-d81a-4f85-baa9-6b127ffb2492 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-2b6fcc44-d81a-4f85-baa9-6b127ffb2492 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2b6fcc44-d81a-4f85-baa9-6b127ffb2492 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2b6fcc44-d81a-4f85-baa9-6b127ffb2492 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:57 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747.263a1e66-d490-4796-98cd-7b7e6f380611 Jul 10 18:31:57 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:57 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:31:57 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7593972b-5558-495b-8ebc-4a225bae0bca tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Acquiring lock "cinder-3d1556f5-98c5-47a9-87b2-83670fbaf5e8-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7593972b-5558-495b-8ebc-4a225bae0bca tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "cinder-3d1556f5-98c5-47a9-87b2-83670fbaf5e8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7593972b-5558-495b-8ebc-4a225bae0bca tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Acquiring lock "cinder-quobyte-3d1556f5-98c5-47a9-87b2-83670fbaf5e8" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7593972b-5558-495b-8ebc-4a225bae0bca tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "cinder-quobyte-3d1556f5-98c5-47a9-87b2-83670fbaf5e8" acquired by "delete_volume" :: waited 0.019s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:57 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebe6f1b-36fe-4365-a6c3-b1ef16caa0b5]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7593972b-5558-495b-8ebc-4a225bae0bca tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3d1556f5-98c5-47a9-87b2-83670fbaf5e8 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:57 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:31:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:57 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:31:57 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:57 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3d1556f5-98c5-47a9-87b2-83670fbaf5e8 Jul 10 18:31:57 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:57 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-15b1dfdd-5349-4ec3-bab7-426e5242d447" returned: 0 in 1.193s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-15b1dfdd-5349-4ec3-bab7-426e5242d447 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:58 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-15b1dfdd-5349-4ec3-bab7-426e5242d447 Jul 10 18:31:58 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:58 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2b6fcc44-d81a-4f85-baa9-6b127ffb2492 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.933s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:58 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-2b6fcc44-d81a-4f85-baa9-6b127ffb2492 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:31:58 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-2b6fcc44-d81a-4f85-baa9-6b127ffb2492 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Deleted volume successfully. Jul 10 18:31:58 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2b6fcc44-d81a-4f85-baa9-6b127ffb2492 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "cinder-9f7ecc3f-b67d-4bcf-948c-d03bcf0941a3-delete_volume" released by "delete_volume" :: held 3.203s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:58 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8919ca77-2cd8-406e-904f-abc9e17f0a48 tempest-ProjectReaderTests-1682954090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747.263a1e66-d490-4796-98cd-7b7e6f380611" returned: 0 in 1.297s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-8919ca77-2cd8-406e-904f-abc9e17f0a48 tempest-ProjectReaderTests-1682954090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b58c1644-3cd8-4544-8412-2724bede6747(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:31:58 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae2f3da-b0a4-43f4-88b3-bbea098ee016]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8919ca77-2cd8-406e-904f-abc9e17f0a48 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:58 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7593972b-5558-495b-8ebc-4a225bae0bca tempest-CreateVolumesFromSourceVolumeTest-272723535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3d1556f5-98c5-47a9-87b2-83670fbaf5e8" returned: 0 in 1.105s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7593972b-5558-495b-8ebc-4a225bae0bca tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3d1556f5-98c5-47a9-87b2-83670fbaf5e8 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:58 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3d1556f5-98c5-47a9-87b2-83670fbaf5e8 Jul 10 18:31:58 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:58 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747 Jul 10 18:31:58 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:58 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.090s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:58 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:31:58 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager._thread_info {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:31:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread count: 28 {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 18:31:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread info: [<_MainThread(MainThread, started 139757428633728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 18:31:58 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-15b1dfdd-5349-4ec3-bab7-426e5242d447" returned: 1 in 1.091s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-15b1dfdd-5349-4ec3-bab7-426e5242d447' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:31:58 devstack cinder-volume[87399]: DEBUG cinder.volume.volume_utils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Downloaded image b4563992-7257-471b-a651-8ccecd8ae81d ((None, [{'url': 'file:///opt/stack/data/glance/images/b4563992-7257-471b-a651-8ccecd8ae81d', 'metadata': {}}])) to volume 15b1dfdd-5349-4ec3-bab7-426e5242d447 successfully. {{(pid=87399) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 18:31:58 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Temporary image b4563992-7257-471b-a651-8ccecd8ae81d for user 8f3f40d8ff8d4971b54f04cae6841379 is deleted. {{(pid=87399) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 10 18:31:58 devstack cinder-volume[87399]: DEBUG cinder.volume.volume_utils [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Marking volume 15b1dfdd-5349-4ec3-bab7-426e5242d447 as bootable. {{(pid=87399) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 18:31:58 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Copying metadata from image b4563992-7257-471b-a651-8ccecd8ae81d to 15b1dfdd-5349-4ec3-bab7-426e5242d447. {{(pid=87399) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 18:31:58 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Creating volume glance metadata for volume 15b1dfdd-5349-4ec3-bab7-426e5242d447 backed by image b4563992-7257-471b-a651-8ccecd8ae81d with: {'image_id': 'b4563992-7257-471b-a651-8ccecd8ae81d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a19da89473d9f9b90a8b4ab0a45c4498', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87399) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67ede721-a467-41eb-af30-bad8eb9f78c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15b1dfdd-5349-4ec3-bab7-426e5242d447', 'volume_size': 1, 'image_id': 'b4563992-7257-471b-a651-8ccecd8ae81d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b4563992-7257-471b-a651-8ccecd8ae81d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a19da89473d9f9b90a8b4ab0a45c4498', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cda813ed52974cf48682a9934f78d3e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '04d06ab5bb3b8ac5ed04c72440c647d30a48ae22070d855b801462c19751af011985d12b76bc9247570befbf6d72555fa264817bceeae1fcd18a46eab1421310', 'id': 'b4563992-7257-471b-a651-8ccecd8ae81d', 'created_at': datetime.datetime(2026, 7, 10, 16, 31, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 16, 31, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b4563992-7257-471b-a651-8ccecd8ae81d/file', 'properties': {}}, 'image_service': }' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8ad71b-7804-43db-b2b5-9256dced7be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:59 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Volume volume-15b1dfdd-5349-4ec3-bab7-426e5242d447 (15b1dfdd-5349-4ec3-bab7-426e5242d447): created successfully Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8ad71b-7804-43db-b2b5-9256dced7be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Flow 'volume_create_manager' (17b7d5bc-eb43-4e3d-98d8-dd5f7b672a6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:31:59 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-64db00e6-ff23-436f-a1c7-2060ce3757a0 tempest-VolumeImageDependencyTests-1573992425 None] Created volume successfully. Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] Flow 'volume_create_manager' (7c5f5abf-7e9b-49c8-bcac-2206ef21de60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e60ca7-793d-46a9-be50-e6ae53320819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:59 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7593972b-5558-495b-8ebc-4a225bae0bca tempest-CreateVolumesFromSourceVolumeTest-272723535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-3d1556f5-98c5-47a9-87b2-83670fbaf5e8" returned: 0 in 0.789s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e60ca7-793d-46a9-be50-e6ae53320819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a1f6f7-d4c2-462e-a42d-08a0df4a0318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60740575acce41648b4fc0b2620ec131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:31:59Z,use_quota=True,user_id='ee83c870901e4a51b3a7f3253e36174b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01463baf-4015-438f-bdcc-b84aa6f6abac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01463baf-4015-438f-bdcc-b84aa6f6abac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b0b9f9-b568-4b94-a03d-d4067d155807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:59 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b0b9f9-b568-4b94-a03d-d4067d155807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2a1f6f7-d4c2-462e-a42d-08a0df4a0318', 'volume_name': 'volume-b2a1f6f7-d4c2-462e-a42d-08a0df4a0318', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d0983a-c2f9-45ed-995d-12d3f240765d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d0983a-c2f9-45ed-995d-12d3f240765d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678cf76a-2a29-47f8-b3e3-6bdfd9e07338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:31:59 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] Volume b2a1f6f7-d4c2-462e-a42d-08a0df4a0318: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2a1f6f7-d4c2-462e-a42d-08a0df4a0318', 'volume_size': 1} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a1f6f7-d4c2-462e-a42d-08a0df4a0318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60740575acce41648b4fc0b2620ec131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:31:59Z,use_quota=True,user_id='ee83c870901e4a51b3a7f3253e36174b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] Creating volume b2a1f6f7-d4c2-462e-a42d-08a0df4a0318 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:31:59 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2a1f6f7-d4c2-462e-a42d-08a0df4a0318 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7593972b-5558-495b-8ebc-4a225bae0bca tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "cinder-quobyte-3d1556f5-98c5-47a9-87b2-83670fbaf5e8" released by "delete_volume" :: held 2.057s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8d4e9814-9f31-4bbb-9eea-8358d374cd3d tempest-VolumeImageDependencyTests-1573992425 None] Acquiring lock "cinder-15b1dfdd-5349-4ec3-bab7-426e5242d447-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8919ca77-2cd8-406e-904f-abc9e17f0a48 tempest-ProjectReaderTests-1682954090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747" returned: 0 in 1.047s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:31:59 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2a1f6f7-d4c2-462e-a42d-08a0df4a0318 1073741824 Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8919ca77-2cd8-406e-904f-abc9e17f0a48 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747.263a1e66-d490-4796-98cd-7b7e6f380611 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:59 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8d4e9814-9f31-4bbb-9eea-8358d374cd3d tempest-VolumeImageDependencyTests-1573992425 None] Lock "cinder-15b1dfdd-5349-4ec3-bab7-426e5242d447-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:59 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747.263a1e66-d490-4796-98cd-7b7e6f380611 Jul 10 18:31:59 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8d4e9814-9f31-4bbb-9eea-8358d374cd3d tempest-VolumeImageDependencyTests-1573992425 None] Acquiring lock "cinder-quobyte-15b1dfdd-5349-4ec3-bab7-426e5242d447" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8d4e9814-9f31-4bbb-9eea-8358d374cd3d tempest-VolumeImageDependencyTests-1573992425 None] Lock "cinder-quobyte-15b1dfdd-5349-4ec3-bab7-426e5242d447" acquired by "delete_volume" :: waited 0.026s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-7593972b-5558-495b-8ebc-4a225bae0bca tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Created reservations ['94c0669b-182e-483c-a9ca-b41df861734a', 'ff9cdf5a-3831-47e8-a758-17b2de4d2776', '83a49325-7db1-4bde-a480-a4f02d03ca7a', 'f828929c-2339-4f88-bfeb-f54b35307de6'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb179c0-d4f5-4e69-b4f9-0944fffc59db]: (4, 'raw') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8d4e9814-9f31-4bbb-9eea-8358d374cd3d tempest-VolumeImageDependencyTests-1573992425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-15b1dfdd-5349-4ec3-bab7-426e5242d447 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7593972b-5558-495b-8ebc-4a225bae0bca tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7593972b-5558-495b-8ebc-4a225bae0bca tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7593972b-5558-495b-8ebc-4a225bae0bca tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7593972b-5558-495b-8ebc-4a225bae0bca tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7593972b-5558-495b-8ebc-4a225bae0bca tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:31:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7593972b-5558-495b-8ebc-4a225bae0bca tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:31:59 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:31:59 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:31:59 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-15b1dfdd-5349-4ec3-bab7-426e5242d447 Jul 10 18:31:59 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:00 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8919ca77-2cd8-406e-904f-abc9e17f0a48 tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747.263a1e66-d490-4796-98cd-7b7e6f380611" returned: 0 in 0.841s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8919ca77-2cd8-406e-904f-abc9e17f0a48 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747.263a1e66-d490-4796-98cd-7b7e6f380611 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:00 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747.263a1e66-d490-4796-98cd-7b7e6f380611 Jul 10 18:32:00 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:00 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7593972b-5558-495b-8ebc-4a225bae0bca tempest-CreateVolumesFromSourceVolumeTest-272723535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.682s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:00 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-7593972b-5558-495b-8ebc-4a225bae0bca tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:32:00 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-7593972b-5558-495b-8ebc-4a225bae0bca tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Deleted volume successfully. Jul 10 18:32:00 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2a1f6f7-d4c2-462e-a42d-08a0df4a0318 1073741824" returned: 0 in 0.975s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:00 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7593972b-5558-495b-8ebc-4a225bae0bca tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "cinder-3d1556f5-98c5-47a9-87b2-83670fbaf5e8-delete_volume" released by "delete_volume" :: held 3.106s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2a1f6f7-d4c2-462e-a42d-08a0df4a0318 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:00 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2a1f6f7-d4c2-462e-a42d-08a0df4a0318 Jul 10 18:32:00 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:00 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8d4e9814-9f31-4bbb-9eea-8358d374cd3d tempest-VolumeImageDependencyTests-1573992425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-15b1dfdd-5349-4ec3-bab7-426e5242d447" returned: 0 in 0.957s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8d4e9814-9f31-4bbb-9eea-8358d374cd3d tempest-VolumeImageDependencyTests-1573992425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-15b1dfdd-5349-4ec3-bab7-426e5242d447 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:00 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b2d3e0ca-38da-410a-a93c-f8f230f8f019 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Acquiring lock "cinder-1d1e6829-9cf0-499a-bf9e-ed94727d3ae2-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:00 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b2d3e0ca-38da-410a-a93c-f8f230f8f019 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "cinder-1d1e6829-9cf0-499a-bf9e-ed94727d3ae2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:00 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b2d3e0ca-38da-410a-a93c-f8f230f8f019 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Acquiring lock "cinder-quobyte-1d1e6829-9cf0-499a-bf9e-ed94727d3ae2" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:00 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b2d3e0ca-38da-410a-a93c-f8f230f8f019 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "cinder-quobyte-1d1e6829-9cf0-499a-bf9e-ed94727d3ae2" acquired by "delete_volume" :: waited 0.026s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:00 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-15b1dfdd-5349-4ec3-bab7-426e5242d447 Jul 10 18:32:00 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:00 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cfd94c-6acf-4720-96dc-0e642c6260e4]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:32:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b2d3e0ca-38da-410a-a93c-f8f230f8f019 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1d1e6829-9cf0-499a-bf9e-ed94727d3ae2 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:00 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1d1e6829-9cf0-499a-bf9e-ed94727d3ae2 Jul 10 18:32:00 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:01 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8919ca77-2cd8-406e-904f-abc9e17f0a48 tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747.263a1e66-d490-4796-98cd-7b7e6f380611" returned: 0 in 0.813s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8919ca77-2cd8-406e-904f-abc9e17f0a48 tempest-ProjectReaderTests-1682954090 None] Lock "cinder-quobyte-263a1e66-d490-4796-98cd-7b7e6f380611" released by "_delete_snapshot" :: held 4.142s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8919ca77-2cd8-406e-904f-abc9e17f0a48 tempest-ProjectReaderTests-1682954090 None] Lock "cinder-quobyte-b58c1644-3cd8-4544-8412-2724bede6747" released by "delete_snapshot" :: held 4.193s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:01 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2a1f6f7-d4c2-462e-a42d-08a0df4a0318" returned: 0 in 0.803s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:01 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] <== create_volume: return (1837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:32:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.840s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:32:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678cf76a-2a29-47f8-b3e3-6bdfd9e07338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2a1f6f7-d4c2-462e-a42d-08a0df4a0318', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c809182d-d1a9-4b31-bdf9-8365b63c967c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:01 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] Volume volume-b2a1f6f7-d4c2-462e-a42d-08a0df4a0318 (b2a1f6f7-d4c2-462e-a42d-08a0df4a0318): created successfully Jul 10 18:32:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c809182d-d1a9-4b31-bdf9-8365b63c967c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:01 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] Flow 'volume_create_manager' (7c5f5abf-7e9b-49c8-bcac-2206ef21de60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:32:01 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-8919ca77-2cd8-406e-904f-abc9e17f0a48 tempest-ProjectReaderTests-1682954090 None] Created reservations ['e7500105-6d1a-435e-b980-ffeab2c2ce70', '99582872-18f6-4eff-8ac7-fcffd3ccf2e3', 'f5064531-393f-4f61-b726-39d97d6dd466', 'bc531b97-a326-48fc-9991-15e733db3568'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:32:01 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-27c4850e-34f5-444c-9d35-7f62b7796cbb tempest-CinderUnicodeTest-806353781 None] Created volume successfully. Jul 10 18:32:01 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-8919ca77-2cd8-406e-904f-abc9e17f0a48 tempest-ProjectReaderTests-1682954090 None] Delete snapshot completed successfully. Jul 10 18:32:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8919ca77-2cd8-406e-904f-abc9e17f0a48 tempest-ProjectReaderTests-1682954090 None] Lock "cinder-263a1e66-d490-4796-98cd-7b7e6f380611-delete_snapshot" released by "delete_snapshot" :: held 4.462s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:01 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8d4e9814-9f31-4bbb-9eea-8358d374cd3d tempest-VolumeImageDependencyTests-1573992425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-15b1dfdd-5349-4ec3-bab7-426e5242d447" returned: 1 in 0.997s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8d4e9814-9f31-4bbb-9eea-8358d374cd3d tempest-VolumeImageDependencyTests-1573992425 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-15b1dfdd-5349-4ec3-bab7-426e5242d447' failed. Not Retrying. {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 18:32:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8d4e9814-9f31-4bbb-9eea-8358d374cd3d tempest-VolumeImageDependencyTests-1573992425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-15b1dfdd-5349-4ec3-bab7-426e5242d447 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:01 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-15b1dfdd-5349-4ec3-bab7-426e5242d447 Jul 10 18:32:01 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:01 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b2d3e0ca-38da-410a-a93c-f8f230f8f019 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1d1e6829-9cf0-499a-bf9e-ed94727d3ae2" returned: 0 in 0.815s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b2d3e0ca-38da-410a-a93c-f8f230f8f019 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1d1e6829-9cf0-499a-bf9e-ed94727d3ae2 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:01 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1d1e6829-9cf0-499a-bf9e-ed94727d3ae2 Jul 10 18:32:01 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:02 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:02 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-eea692cd-5dae-418b-a28e-7c141992a9fc tempest-ProjectReaderTests-1682954090 None] Acquiring lock "cinder-b58c1644-3cd8-4544-8412-2724bede6747-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8d4e9814-9f31-4bbb-9eea-8358d374cd3d tempest-VolumeImageDependencyTests-1573992425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-15b1dfdd-5349-4ec3-bab7-426e5242d447" returned: 0 in 0.687s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b2d3e0ca-38da-410a-a93c-f8f230f8f019 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-1d1e6829-9cf0-499a-bf9e-ed94727d3ae2" returned: 0 in 0.635s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b2d3e0ca-38da-410a-a93c-f8f230f8f019 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "cinder-quobyte-1d1e6829-9cf0-499a-bf9e-ed94727d3ae2" released by "delete_volume" :: held 1.514s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8d4e9814-9f31-4bbb-9eea-8358d374cd3d tempest-VolumeImageDependencyTests-1573992425 None] Lock "cinder-quobyte-15b1dfdd-5349-4ec3-bab7-426e5242d447" released by "delete_volume" :: held 2.752s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-eea692cd-5dae-418b-a28e-7c141992a9fc tempest-ProjectReaderTests-1682954090 None] Lock "cinder-b58c1644-3cd8-4544-8412-2724bede6747-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-eea692cd-5dae-418b-a28e-7c141992a9fc tempest-ProjectReaderTests-1682954090 None] Acquiring lock "cinder-quobyte-b58c1644-3cd8-4544-8412-2724bede6747" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:02 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-b2d3e0ca-38da-410a-a93c-f8f230f8f019 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Created reservations ['e12f1281-9b36-47fd-b7c2-88cfdb3961c8', '4bb9b891-e749-4f8a-87a7-7205900cb890', '5320c561-7aee-49fb-8fc8-db31024fb595', '77ace651-e092-4c92-8e5d-36529b4a02be'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:32:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-eea692cd-5dae-418b-a28e-7c141992a9fc tempest-ProjectReaderTests-1682954090 None] Lock "cinder-quobyte-b58c1644-3cd8-4544-8412-2724bede6747" acquired by "delete_volume" :: waited 0.034s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:02 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[24291d42-c618-4ff9-8719-d789a3fcbe41]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:32:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-eea692cd-5dae-418b-a28e-7c141992a9fc tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:02 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-8d4e9814-9f31-4bbb-9eea-8358d374cd3d tempest-VolumeImageDependencyTests-1573992425 None] Created reservations ['fb18a020-059c-45fe-87dd-2aa788981180', '19929e6b-f31a-4fff-9b58-e5abc6bae296', '60747405-7428-4421-b4df-9ae5c79a9f8e', 'e3d2cb3c-fbf6-4854-8403-4e6eff418bf9'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:32:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b2d3e0ca-38da-410a-a93c-f8f230f8f019 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:32:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b2d3e0ca-38da-410a-a93c-f8f230f8f019 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:32:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b2d3e0ca-38da-410a-a93c-f8f230f8f019 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:32:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b2d3e0ca-38da-410a-a93c-f8f230f8f019 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:32:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b2d3e0ca-38da-410a-a93c-f8f230f8f019 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:32:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b2d3e0ca-38da-410a-a93c-f8f230f8f019 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:02 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747 Jul 10 18:32:02 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8d4e9814-9f31-4bbb-9eea-8358d374cd3d tempest-VolumeImageDependencyTests-1573992425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:32:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8d4e9814-9f31-4bbb-9eea-8358d374cd3d tempest-VolumeImageDependencyTests-1573992425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:32:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8d4e9814-9f31-4bbb-9eea-8358d374cd3d tempest-VolumeImageDependencyTests-1573992425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:32:02 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:32:02 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8d4e9814-9f31-4bbb-9eea-8358d374cd3d tempest-VolumeImageDependencyTests-1573992425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:32:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8d4e9814-9f31-4bbb-9eea-8358d374cd3d tempest-VolumeImageDependencyTests-1573992425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:32:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8d4e9814-9f31-4bbb-9eea-8358d374cd3d tempest-VolumeImageDependencyTests-1573992425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:02 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:32:02 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:03 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:32:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] Flow 'volume_create_manager' (7d19e613-f48e-4baf-93ba-77ab7ffee64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:32:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e69f9a32-9466-4f58-8020-4bf1bcc04f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e69f9a32-9466-4f58-8020-4bf1bcc04f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:32:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-629180963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1d26421-ecbf-4293-aa15-81b5eb37c155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60740575acce41648b4fc0b2620ec131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:32:03Z,use_quota=True,user_id='ee83c870901e4a51b3a7f3253e36174b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd4b1a4-12e1-47cb-afb5-ba85e999f820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd4b1a4-12e1-47cb-afb5-ba85e999f820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4744c34d-46e0-4c4f-988f-2d5e227c999f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4744c34d-46e0-4c4f-988f-2d5e227c999f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1d26421-ecbf-4293-aa15-81b5eb37c155', 'volume_name': 'volume-f1d26421-ecbf-4293-aa15-81b5eb37c155', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c24dd1d-7223-4e7e-92d3-095cf6d55415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c24dd1d-7223-4e7e-92d3-095cf6d55415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20b779f1-8d02-4656-8645-f1622ace174a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:03 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] Volume f1d26421-ecbf-4293-aa15-81b5eb37c155: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1d26421-ecbf-4293-aa15-81b5eb37c155', 'volume_size': 1} Jul 10 18:32:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:32:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:32:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:32:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-629180963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1d26421-ecbf-4293-aa15-81b5eb37c155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60740575acce41648b4fc0b2620ec131',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:32:03Z,use_quota=True,user_id='ee83c870901e4a51b3a7f3253e36174b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:32:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] Creating volume f1d26421-ecbf-4293-aa15-81b5eb37c155 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:32:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:32:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:32:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:32:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:32:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:32:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:32:03 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:32:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:03 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155 1073741824 Jul 10 18:32:03 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:03 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b2d3e0ca-38da-410a-a93c-f8f230f8f019 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.968s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:03 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-b2d3e0ca-38da-410a-a93c-f8f230f8f019 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:32:03 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-b2d3e0ca-38da-410a-a93c-f8f230f8f019 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Deleted volume successfully. Jul 10 18:32:03 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b2d3e0ca-38da-410a-a93c-f8f230f8f019 tempest-CreateVolumesFromSourceVolumeTest-272723535 None] Lock "cinder-1d1e6829-9cf0-499a-bf9e-ed94727d3ae2-delete_volume" released by "delete_volume" :: held 2.915s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:03 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8d4e9814-9f31-4bbb-9eea-8358d374cd3d tempest-VolumeImageDependencyTests-1573992425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.172s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:03 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-8d4e9814-9f31-4bbb-9eea-8358d374cd3d tempest-VolumeImageDependencyTests-1573992425 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:32:03 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-8d4e9814-9f31-4bbb-9eea-8358d374cd3d tempest-VolumeImageDependencyTests-1573992425 None] Deleted volume successfully. Jul 10 18:32:03 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-eea692cd-5dae-418b-a28e-7c141992a9fc tempest-ProjectReaderTests-1682954090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747" returned: 0 in 1.349s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-eea692cd-5dae-418b-a28e-7c141992a9fc tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:03 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8d4e9814-9f31-4bbb-9eea-8358d374cd3d tempest-VolumeImageDependencyTests-1573992425 None] Lock "cinder-15b1dfdd-5349-4ec3-bab7-426e5242d447-delete_volume" released by "delete_volume" :: held 4.374s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:03 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747 Jul 10 18:32:03 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:04 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155 1073741824" returned: 0 in 1.300s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:04 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-eea692cd-5dae-418b-a28e-7c141992a9fc tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b58c1644-3cd8-4544-8412-2724bede6747" returned: 0 in 0.959s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:04 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155 Jul 10 18:32:04 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:04 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-eea692cd-5dae-418b-a28e-7c141992a9fc tempest-ProjectReaderTests-1682954090 None] Lock "cinder-quobyte-b58c1644-3cd8-4544-8412-2724bede6747" released by "delete_volume" :: held 2.397s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:04 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-eea692cd-5dae-418b-a28e-7c141992a9fc tempest-ProjectReaderTests-1682954090 None] Created reservations ['6f030d1b-ec98-419c-bd57-ee2cdd51d8b3', '3b75749b-98f2-40fd-855b-ce7156f6207a', 'af08c6e9-3618-453a-92a8-bd4f4b978e64', 'ab58e907-353c-4298-bc4a-6116a5b796b4'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:32:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-eea692cd-5dae-418b-a28e-7c141992a9fc tempest-ProjectReaderTests-1682954090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:32:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-eea692cd-5dae-418b-a28e-7c141992a9fc tempest-ProjectReaderTests-1682954090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:32:05 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-eea692cd-5dae-418b-a28e-7c141992a9fc tempest-ProjectReaderTests-1682954090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:32:05 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-eea692cd-5dae-418b-a28e-7c141992a9fc tempest-ProjectReaderTests-1682954090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:32:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-eea692cd-5dae-418b-a28e-7c141992a9fc tempest-ProjectReaderTests-1682954090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:32:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-eea692cd-5dae-418b-a28e-7c141992a9fc tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:05 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:32:05 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:05 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155" returned: 0 in 0.933s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:05 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] <== create_volume: return (2303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:32:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.311s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:32:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20b779f1-8d02-4656-8645-f1622ace174a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1d26421-ecbf-4293-aa15-81b5eb37c155', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffb0a47c-e5ac-41a0-94bb-f04ec25f1395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:05 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] Volume volume-f1d26421-ecbf-4293-aa15-81b5eb37c155 (f1d26421-ecbf-4293-aa15-81b5eb37c155): created successfully Jul 10 18:32:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffb0a47c-e5ac-41a0-94bb-f04ec25f1395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] Flow 'volume_create_manager' (7d19e613-f48e-4baf-93ba-77ab7ffee64c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:32:05 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-eea692cd-5dae-418b-a28e-7c141992a9fc tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.811s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:05 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-eea692cd-5dae-418b-a28e-7c141992a9fc tempest-ProjectReaderTests-1682954090 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:32:05 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-eea692cd-5dae-418b-a28e-7c141992a9fc tempest-ProjectReaderTests-1682954090 None] Deleted volume successfully. Jul 10 18:32:05 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-c41d6e99-3c40-4059-bea4-e553dc3b04b9 tempest-CinderUnicodeTest-806353781 None] Created volume successfully. Jul 10 18:32:05 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-eea692cd-5dae-418b-a28e-7c141992a9fc tempest-ProjectReaderTests-1682954090 None] Lock "cinder-b58c1644-3cd8-4544-8412-2724bede6747-delete_volume" released by "delete_volume" :: held 3.560s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:06 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:32:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] Flow 'volume_create_manager' (2f94a06d-8f20-4e3b-8727-e1f3019cc72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:32:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caac100f-cbd5-4d16-866c-44f7bbc74cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caac100f-cbd5-4d16-866c-44f7bbc74cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1425764438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56709d53-12cc-43b6-b259-1d26c1636be2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='935a1657e6614ac3a2269f04e097247e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:32:06Z,use_quota=True,user_id='bf797658fda948239bec7f0bcb759bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b5a0963-aa24-4b3b-99ce-416840e90b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b5a0963-aa24-4b3b-99ce-416840e90b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d74ca108-c752-4bb9-aa82-48746289e56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d74ca108-c752-4bb9-aa82-48746289e56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56709d53-12cc-43b6-b259-1d26c1636be2', 'volume_name': 'volume-56709d53-12cc-43b6-b259-1d26c1636be2', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d3331b-e72f-4f40-8d65-0584d2e20f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d3331b-e72f-4f40-8d65-0584d2e20f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a3f517e-8612-4511-94f4-fe75db015485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:06 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] Volume 56709d53-12cc-43b6-b259-1d26c1636be2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56709d53-12cc-43b6-b259-1d26c1636be2', 'volume_size': 1} Jul 10 18:32:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:32:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:32:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1425764438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56709d53-12cc-43b6-b259-1d26c1636be2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='935a1657e6614ac3a2269f04e097247e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:32:06Z,use_quota=True,user_id='bf797658fda948239bec7f0bcb759bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:32:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] Creating volume 56709d53-12cc-43b6-b259-1d26c1636be2 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:32:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:32:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:32:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:32:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:32:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:32:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:32:06 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:32:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:06 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2 1073741824 Jul 10 18:32:06 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6535d4c1-bbcb-46c3-be79-c4f42a176b84 tempest-CinderUnicodeTest-806353781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:32:07 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2 1073741824" returned: 0 in 1.044s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:07 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2 Jul 10 18:32:07 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-af9005b4-3afa-4cbc-9d94-f5324d650ef0 tempest-ProjectAdminTests-984729327 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.757713317871, 'free_capacity_gb': 1775.757713317871, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87399) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 10 18:32:07 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:32:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] Flow 'volume_create_manager' (02b1f10a-5903-4785-9fe8-c184a3494aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:32:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9f8081b-cd6a-412d-8e54-9b0ddc385674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9f8081b-cd6a-412d-8e54-9b0ddc385674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1778260381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1762542-8f74-45e6-8a58-6fb124a5d87e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab5573a169b463e9ccae9d5c832530c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:32:08Z,use_quota=True,user_id='db9bc81f72324f5da33633fdc460fbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb096c52-eb47-4046-8bd0-16cfdad8952a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb096c52-eb47-4046-8bd0-16cfdad8952a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b86cec5-aa9c-4d43-a9ed-f69683d19ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b86cec5-aa9c-4d43-a9ed-f69683d19ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1762542-8f74-45e6-8a58-6fb124a5d87e', 'volume_name': 'volume-a1762542-8f74-45e6-8a58-6fb124a5d87e', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b452f7-a497-4000-baba-59929ebfce41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b452f7-a497-4000-baba-59929ebfce41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:07 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb1e0b5d-4902-4e1d-a195-64ed90cdfd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:07 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] Volume a1762542-8f74-45e6-8a58-6fb124a5d87e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1762542-8f74-45e6-8a58-6fb124a5d87e', 'volume_size': 1} Jul 10 18:32:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:32:08 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2" returned: 0 in 0.671s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] <== create_volume: return (1756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:32:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.759s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:32:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6535d4c1-bbcb-46c3-be79-c4f42a176b84 tempest-CinderUnicodeTest-806353781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.480s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:32:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-6535d4c1-bbcb-46c3-be79-c4f42a176b84 tempest-CinderUnicodeTest-806353781 None] Creating offline snapshot e78c3de8-2a0a-474d-b65b-34aed39c5e14 of volume f1d26421-ecbf-4293-aa15-81b5eb37c155 {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:32:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a3f517e-8612-4511-94f4-fe75db015485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56709d53-12cc-43b6-b259-1d26c1636be2', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0796aad4-7504-4538-9fcf-d0ee71dc087b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:08 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed69da0-bf73-4ba0-b230-20e0a23cca3e]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:32:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6535d4c1-bbcb-46c3-be79-c4f42a176b84 tempest-CinderUnicodeTest-806353781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:08 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] Volume volume-56709d53-12cc-43b6-b259-1d26c1636be2 (56709d53-12cc-43b6-b259-1d26c1636be2): created successfully Jul 10 18:32:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0796aad4-7504-4538-9fcf-d0ee71dc087b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:08 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] Flow 'volume_create_manager' (2f94a06d-8f20-4e3b-8727-e1f3019cc72e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:32:08 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-5b125c0a-c32e-4ba9-a1cf-edb16a48a24d tempest-ProjectReaderTests-1682954090 None] Created volume successfully. Jul 10 18:32:08 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155 Jul 10 18:32:08 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4da01744-f26c-4663-86c2-245c0b3b603e tempest-ProjectReaderTests-1682954090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:32:08 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6535d4c1-bbcb-46c3-be79-c4f42a176b84 tempest-CinderUnicodeTest-806353781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155" returned: 0 in 0.823s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6535d4c1-bbcb-46c3-be79-c4f42a176b84 tempest-CinderUnicodeTest-806353781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155.e78c3de8-2a0a-474d-b65b-34aed39c5e14 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:09 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155.e78c3de8-2a0a-474d-b65b-34aed39c5e14 1G Jul 10 18:32:09 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:09 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6535d4c1-bbcb-46c3-be79-c4f42a176b84 tempest-CinderUnicodeTest-806353781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155.e78c3de8-2a0a-474d-b65b-34aed39c5e14 1G" returned: 0 in 0.873s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6535d4c1-bbcb-46c3-be79-c4f42a176b84 tempest-CinderUnicodeTest-806353781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1d26421-ecbf-4293-aa15-81b5eb37c155 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155.e78c3de8-2a0a-474d-b65b-34aed39c5e14 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:09 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1d26421-ecbf-4293-aa15-81b5eb37c155 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155.e78c3de8-2a0a-474d-b65b-34aed39c5e14 Jul 10 18:32:09 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:10 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6535d4c1-bbcb-46c3-be79-c4f42a176b84 tempest-CinderUnicodeTest-806353781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1d26421-ecbf-4293-aa15-81b5eb37c155 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155.e78c3de8-2a0a-474d-b65b-34aed39c5e14" returned: 0 in 0.705s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:10 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-6535d4c1-bbcb-46c3-be79-c4f42a176b84 tempest-CinderUnicodeTest-806353781 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155.e78c3de8-2a0a-474d-b65b-34aed39c5e14 is being set with open permissions: ugo+rw Jul 10 18:32:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6535d4c1-bbcb-46c3-be79-c4f42a176b84 tempest-CinderUnicodeTest-806353781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155.e78c3de8-2a0a-474d-b65b-34aed39c5e14 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:10 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155.e78c3de8-2a0a-474d-b65b-34aed39c5e14 Jul 10 18:32:10 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:11 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6535d4c1-bbcb-46c3-be79-c4f42a176b84 tempest-CinderUnicodeTest-806353781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155.e78c3de8-2a0a-474d-b65b-34aed39c5e14" returned: 0 in 0.669s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6535d4c1-bbcb-46c3-be79-c4f42a176b84 tempest-CinderUnicodeTest-806353781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:11 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155.info Jul 10 18:32:11 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:11 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6535d4c1-bbcb-46c3-be79-c4f42a176b84 tempest-CinderUnicodeTest-806353781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155.info" returned: 0 in 0.651s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:11 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-6535d4c1-bbcb-46c3-be79-c4f42a176b84 tempest-CinderUnicodeTest-806353781 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155.info is being set with open permissions: ugo+rw Jul 10 18:32:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6535d4c1-bbcb-46c3-be79-c4f42a176b84 tempest-CinderUnicodeTest-806353781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:11 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155.info Jul 10 18:32:11 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:12 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-6535d4c1-bbcb-46c3-be79-c4f42a176b84 tempest-CinderUnicodeTest-806353781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155.info" returned: 0 in 0.643s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-6535d4c1-bbcb-46c3-be79-c4f42a176b84 tempest-CinderUnicodeTest-806353781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.452s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:32:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.660s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:32:12 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:32:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1778260381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1762542-8f74-45e6-8a58-6fb124a5d87e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab5573a169b463e9ccae9d5c832530c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:32:08Z,use_quota=True,user_id='db9bc81f72324f5da33633fdc460fbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:32:12 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] Creating volume a1762542-8f74-45e6-8a58-6fb124a5d87e {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:32:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:32:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:32:12 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:32:12 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:32:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:32:12 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:32:12 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:32:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:12 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e 1073741824 Jul 10 18:32:12 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:12 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-6535d4c1-bbcb-46c3-be79-c4f42a176b84 tempest-CinderUnicodeTest-806353781 None] Create snapshot completed successfully Jul 10 18:32:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-df9be141-8427-4028-8bbe-2af673b2fe39 tempest-CinderUnicodeTest-806353781 None] Acquiring lock "cinder-e78c3de8-2a0a-474d-b65b-34aed39c5e14-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-df9be141-8427-4028-8bbe-2af673b2fe39 tempest-CinderUnicodeTest-806353781 None] Lock "cinder-e78c3de8-2a0a-474d-b65b-34aed39c5e14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-df9be141-8427-4028-8bbe-2af673b2fe39 tempest-CinderUnicodeTest-806353781 None] Acquiring lock "cinder-quobyte-f1d26421-ecbf-4293-aa15-81b5eb37c155" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-df9be141-8427-4028-8bbe-2af673b2fe39 tempest-CinderUnicodeTest-806353781 None] Lock "cinder-quobyte-f1d26421-ecbf-4293-aa15-81b5eb37c155" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-df9be141-8427-4028-8bbe-2af673b2fe39 tempest-CinderUnicodeTest-806353781 None] Acquiring lock "cinder-quobyte-e78c3de8-2a0a-474d-b65b-34aed39c5e14" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:13 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-df9be141-8427-4028-8bbe-2af673b2fe39 tempest-CinderUnicodeTest-806353781 None] Lock "cinder-quobyte-e78c3de8-2a0a-474d-b65b-34aed39c5e14" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:13 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-df9be141-8427-4028-8bbe-2af673b2fe39 tempest-CinderUnicodeTest-806353781 None] Deleting offline snapshot e78c3de8-2a0a-474d-b65b-34aed39c5e14 of volume f1d26421-ecbf-4293-aa15-81b5eb37c155 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:32:13 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-df9be141-8427-4028-8bbe-2af673b2fe39 tempest-CinderUnicodeTest-806353781 None] snapshot_file for this snap is: volume-f1d26421-ecbf-4293-aa15-81b5eb37c155.e78c3de8-2a0a-474d-b65b-34aed39c5e14 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:32:13 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[53260a2b-a0ab-47d9-84ea-2f89b001eebb]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:32:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-df9be141-8427-4028-8bbe-2af673b2fe39 tempest-CinderUnicodeTest-806353781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155.e78c3de8-2a0a-474d-b65b-34aed39c5e14 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:13 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155.e78c3de8-2a0a-474d-b65b-34aed39c5e14 Jul 10 18:32:13 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:13 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e 1073741824" returned: 0 in 0.919s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:13 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e Jul 10 18:32:13 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:13 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-df9be141-8427-4028-8bbe-2af673b2fe39 tempest-CinderUnicodeTest-806353781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155.e78c3de8-2a0a-474d-b65b-34aed39c5e14" returned: 0 in 0.838s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:13 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-df9be141-8427-4028-8bbe-2af673b2fe39 tempest-CinderUnicodeTest-806353781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1d26421-ecbf-4293-aa15-81b5eb37c155(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:32:13 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[228a4f32-c8b6-4868-80ec-b4f7c1acd850]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:32:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-df9be141-8427-4028-8bbe-2af673b2fe39 tempest-CinderUnicodeTest-806353781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:14 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155 Jul 10 18:32:14 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:14 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e" returned: 0 in 0.716s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:14 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:32:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:32:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4da01744-f26c-4663-86c2-245c0b3b603e tempest-ProjectReaderTests-1682954090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.758s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:32:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb1e0b5d-4902-4e1d-a195-64ed90cdfd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1762542-8f74-45e6-8a58-6fb124a5d87e', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1562f64c-9e58-4c13-bbc2-f614a40c4d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:14 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-4da01744-f26c-4663-86c2-245c0b3b603e tempest-ProjectReaderTests-1682954090 None] Creating offline snapshot f7eb8895-8490-4b9f-b03d-5e10d47ccddb of volume 56709d53-12cc-43b6-b259-1d26c1636be2 {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:32:14 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] Volume volume-a1762542-8f74-45e6-8a58-6fb124a5d87e (a1762542-8f74-45e6-8a58-6fb124a5d87e): created successfully Jul 10 18:32:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1562f64c-9e58-4c13-bbc2-f614a40c4d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:14 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] Flow 'volume_create_manager' (02b1f10a-5903-4785-9fe8-c184a3494aaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:32:14 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7889bac-b3bf-4584-bcec-213648882ffb]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:32:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4da01744-f26c-4663-86c2-245c0b3b603e tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:14 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-a71abbcd-9bb2-4014-b932-5bba92b276fb tempest-ProjectMemberTests-1041831846 None] Created volume successfully. Jul 10 18:32:14 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2 Jul 10 18:32:14 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:14 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-df9be141-8427-4028-8bbe-2af673b2fe39 tempest-CinderUnicodeTest-806353781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155" returned: 0 in 0.901s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-df9be141-8427-4028-8bbe-2af673b2fe39 tempest-CinderUnicodeTest-806353781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155.e78c3de8-2a0a-474d-b65b-34aed39c5e14 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:14 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155.e78c3de8-2a0a-474d-b65b-34aed39c5e14 Jul 10 18:32:14 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:15 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4da01744-f26c-4663-86c2-245c0b3b603e tempest-ProjectReaderTests-1682954090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2" returned: 0 in 0.928s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4da01744-f26c-4663-86c2-245c0b3b603e tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2.f7eb8895-8490-4b9f-b03d-5e10d47ccddb 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:15 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2.f7eb8895-8490-4b9f-b03d-5e10d47ccddb 1G Jul 10 18:32:15 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:15 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-df9be141-8427-4028-8bbe-2af673b2fe39 tempest-CinderUnicodeTest-806353781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155.e78c3de8-2a0a-474d-b65b-34aed39c5e14" returned: 0 in 0.840s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-df9be141-8427-4028-8bbe-2af673b2fe39 tempest-CinderUnicodeTest-806353781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155.e78c3de8-2a0a-474d-b65b-34aed39c5e14 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:15 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155.e78c3de8-2a0a-474d-b65b-34aed39c5e14 Jul 10 18:32:15 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d6a8b0bf-ed16-4bd2-878c-b82e87dc0165 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:32:16 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4da01744-f26c-4663-86c2-245c0b3b603e tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2.f7eb8895-8490-4b9f-b03d-5e10d47ccddb 1G" returned: 0 in 0.993s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4da01744-f26c-4663-86c2-245c0b3b603e tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56709d53-12cc-43b6-b259-1d26c1636be2 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2.f7eb8895-8490-4b9f-b03d-5e10d47ccddb {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:16 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56709d53-12cc-43b6-b259-1d26c1636be2 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2.f7eb8895-8490-4b9f-b03d-5e10d47ccddb Jul 10 18:32:16 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:16 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-df9be141-8427-4028-8bbe-2af673b2fe39 tempest-CinderUnicodeTest-806353781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155.e78c3de8-2a0a-474d-b65b-34aed39c5e14" returned: 0 in 0.776s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:16 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-df9be141-8427-4028-8bbe-2af673b2fe39 tempest-CinderUnicodeTest-806353781 None] Lock "cinder-quobyte-e78c3de8-2a0a-474d-b65b-34aed39c5e14" released by "_delete_snapshot" :: held 3.525s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:16 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-df9be141-8427-4028-8bbe-2af673b2fe39 tempest-CinderUnicodeTest-806353781 None] Lock "cinder-quobyte-f1d26421-ecbf-4293-aa15-81b5eb37c155" released by "delete_snapshot" :: held 3.555s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:16 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-df9be141-8427-4028-8bbe-2af673b2fe39 tempest-CinderUnicodeTest-806353781 None] Created reservations ['26a03c57-0d68-40b4-baa5-e8252fb5d6ef', '4583f132-7699-4f9f-a7b4-bf2f34ad18cd', 'd2b734f2-fda5-4384-a3f4-46e43f235ad2', '4c863db2-2a88-43fd-bc2c-0b0f56f48bd9'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:32:16 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-df9be141-8427-4028-8bbe-2af673b2fe39 tempest-CinderUnicodeTest-806353781 None] Delete snapshot completed successfully. Jul 10 18:32:16 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-df9be141-8427-4028-8bbe-2af673b2fe39 tempest-CinderUnicodeTest-806353781 None] Lock "cinder-e78c3de8-2a0a-474d-b65b-34aed39c5e14-delete_snapshot" released by "delete_snapshot" :: held 3.708s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:17 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4da01744-f26c-4663-86c2-245c0b3b603e tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56709d53-12cc-43b6-b259-1d26c1636be2 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2.f7eb8895-8490-4b9f-b03d-5e10d47ccddb" returned: 0 in 0.753s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:17 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-4da01744-f26c-4663-86c2-245c0b3b603e tempest-ProjectReaderTests-1682954090 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2.f7eb8895-8490-4b9f-b03d-5e10d47ccddb is being set with open permissions: ugo+rw Jul 10 18:32:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4da01744-f26c-4663-86c2-245c0b3b603e tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2.f7eb8895-8490-4b9f-b03d-5e10d47ccddb {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:17 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2.f7eb8895-8490-4b9f-b03d-5e10d47ccddb Jul 10 18:32:17 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:17 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e66e0682-9d61-4fb1-a836-be0b9caeb87d tempest-CinderUnicodeTest-806353781 None] Acquiring lock "cinder-f1d26421-ecbf-4293-aa15-81b5eb37c155-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:17 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e66e0682-9d61-4fb1-a836-be0b9caeb87d tempest-CinderUnicodeTest-806353781 None] Lock "cinder-f1d26421-ecbf-4293-aa15-81b5eb37c155-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:17 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e66e0682-9d61-4fb1-a836-be0b9caeb87d tempest-CinderUnicodeTest-806353781 None] Acquiring lock "cinder-quobyte-f1d26421-ecbf-4293-aa15-81b5eb37c155" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:17 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e66e0682-9d61-4fb1-a836-be0b9caeb87d tempest-CinderUnicodeTest-806353781 None] Lock "cinder-quobyte-f1d26421-ecbf-4293-aa15-81b5eb37c155" acquired by "delete_volume" :: waited 0.017s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:17 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c53ef2e-10e1-419c-8ac3-76172b6a8aaf]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:32:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e66e0682-9d61-4fb1-a836-be0b9caeb87d tempest-CinderUnicodeTest-806353781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:17 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155 Jul 10 18:32:17 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:17 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4da01744-f26c-4663-86c2-245c0b3b603e tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2.f7eb8895-8490-4b9f-b03d-5e10d47ccddb" returned: 0 in 0.688s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4da01744-f26c-4663-86c2-245c0b3b603e tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:17 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2.info Jul 10 18:32:17 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:18 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e66e0682-9d61-4fb1-a836-be0b9caeb87d tempest-CinderUnicodeTest-806353781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155" returned: 0 in 0.808s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e66e0682-9d61-4fb1-a836-be0b9caeb87d tempest-CinderUnicodeTest-806353781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:18 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155 Jul 10 18:32:18 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:18 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4da01744-f26c-4663-86c2-245c0b3b603e tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2.info" returned: 0 in 0.694s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:18 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-4da01744-f26c-4663-86c2-245c0b3b603e tempest-ProjectReaderTests-1682954090 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2.info is being set with open permissions: ugo+rw Jul 10 18:32:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4da01744-f26c-4663-86c2-245c0b3b603e tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:18 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2.info Jul 10 18:32:18 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:18 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e66e0682-9d61-4fb1-a836-be0b9caeb87d tempest-CinderUnicodeTest-806353781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-f1d26421-ecbf-4293-aa15-81b5eb37c155" returned: 0 in 0.692s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:18 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e66e0682-9d61-4fb1-a836-be0b9caeb87d tempest-CinderUnicodeTest-806353781 None] Lock "cinder-quobyte-f1d26421-ecbf-4293-aa15-81b5eb37c155" released by "delete_volume" :: held 1.584s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:18 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-e66e0682-9d61-4fb1-a836-be0b9caeb87d tempest-CinderUnicodeTest-806353781 None] Created reservations ['94da3723-87a0-4f73-bdab-1d4d47c5be47', '2c3d6ccc-4865-4a01-a7bb-e528cb698c18', 'da4ed7a2-4a61-4af9-963d-9a198d79bb9c', 'df35d1da-31a1-4cb9-aa5b-c7dac4ff820a'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:32:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e66e0682-9d61-4fb1-a836-be0b9caeb87d tempest-CinderUnicodeTest-806353781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:32:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e66e0682-9d61-4fb1-a836-be0b9caeb87d tempest-CinderUnicodeTest-806353781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:32:18 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e66e0682-9d61-4fb1-a836-be0b9caeb87d tempest-CinderUnicodeTest-806353781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:32:18 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e66e0682-9d61-4fb1-a836-be0b9caeb87d tempest-CinderUnicodeTest-806353781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:32:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e66e0682-9d61-4fb1-a836-be0b9caeb87d tempest-CinderUnicodeTest-806353781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:32:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e66e0682-9d61-4fb1-a836-be0b9caeb87d tempest-CinderUnicodeTest-806353781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:19 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:32:19 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:19 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4da01744-f26c-4663-86c2-245c0b3b603e tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2.info" returned: 0 in 0.720s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4da01744-f26c-4663-86c2-245c0b3b603e tempest-ProjectReaderTests-1682954090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.917s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:32:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d6a8b0bf-ed16-4bd2-878c-b82e87dc0165 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.298s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:32:19 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-d6a8b0bf-ed16-4bd2-878c-b82e87dc0165 tempest-ProjectMemberTests-1041831846 None] Creating offline snapshot 35531383-a8d7-4331-b56a-dc2fdfc8034c of volume a1762542-8f74-45e6-8a58-6fb124a5d87e {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:32:19 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-4da01744-f26c-4663-86c2-245c0b3b603e tempest-ProjectReaderTests-1682954090 None] Create snapshot completed successfully Jul 10 18:32:19 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4bda20-0453-48ab-8094-f5876917d96b]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:32:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d6a8b0bf-ed16-4bd2-878c-b82e87dc0165 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:19 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e Jul 10 18:32:19 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:19 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b1f81c69-aa82-4df4-b0e7-1c616d0f1666 tempest-CinderUnicodeTest-806353781 None] Acquiring lock "cinder-b2a1f6f7-d4c2-462e-a42d-08a0df4a0318-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:19 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b1f81c69-aa82-4df4-b0e7-1c616d0f1666 tempest-CinderUnicodeTest-806353781 None] Lock "cinder-b2a1f6f7-d4c2-462e-a42d-08a0df4a0318-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:19 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b1f81c69-aa82-4df4-b0e7-1c616d0f1666 tempest-CinderUnicodeTest-806353781 None] Acquiring lock "cinder-quobyte-b2a1f6f7-d4c2-462e-a42d-08a0df4a0318" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:19 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b1f81c69-aa82-4df4-b0e7-1c616d0f1666 tempest-CinderUnicodeTest-806353781 None] Lock "cinder-quobyte-b2a1f6f7-d4c2-462e-a42d-08a0df4a0318" acquired by "delete_volume" :: waited 0.025s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:19 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0a38f9-137f-4399-9109-3fdf4a5f4cb2]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:32:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b1f81c69-aa82-4df4-b0e7-1c616d0f1666 tempest-CinderUnicodeTest-806353781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2a1f6f7-d4c2-462e-a42d-08a0df4a0318 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:19 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e66e0682-9d61-4fb1-a836-be0b9caeb87d tempest-CinderUnicodeTest-806353781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.808s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:19 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-e66e0682-9d61-4fb1-a836-be0b9caeb87d tempest-CinderUnicodeTest-806353781 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:32:19 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-e66e0682-9d61-4fb1-a836-be0b9caeb87d tempest-CinderUnicodeTest-806353781 None] Deleted volume successfully. Jul 10 18:32:19 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2a1f6f7-d4c2-462e-a42d-08a0df4a0318 Jul 10 18:32:19 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:19 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e66e0682-9d61-4fb1-a836-be0b9caeb87d tempest-CinderUnicodeTest-806353781 None] Lock "cinder-f1d26421-ecbf-4293-aa15-81b5eb37c155-delete_volume" released by "delete_volume" :: held 2.635s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:20 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e769e53d-cf86-46b0-bf7a-eff337f50086 tempest-ProjectReaderTests-1682954090 None] Acquiring lock "cinder-f7eb8895-8490-4b9f-b03d-5e10d47ccddb-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:20 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e769e53d-cf86-46b0-bf7a-eff337f50086 tempest-ProjectReaderTests-1682954090 None] Lock "cinder-f7eb8895-8490-4b9f-b03d-5e10d47ccddb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:20 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e769e53d-cf86-46b0-bf7a-eff337f50086 tempest-ProjectReaderTests-1682954090 None] Acquiring lock "cinder-quobyte-56709d53-12cc-43b6-b259-1d26c1636be2" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:20 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e769e53d-cf86-46b0-bf7a-eff337f50086 tempest-ProjectReaderTests-1682954090 None] Lock "cinder-quobyte-56709d53-12cc-43b6-b259-1d26c1636be2" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:20 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e769e53d-cf86-46b0-bf7a-eff337f50086 tempest-ProjectReaderTests-1682954090 None] Acquiring lock "cinder-quobyte-f7eb8895-8490-4b9f-b03d-5e10d47ccddb" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:20 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e769e53d-cf86-46b0-bf7a-eff337f50086 tempest-ProjectReaderTests-1682954090 None] Lock "cinder-quobyte-f7eb8895-8490-4b9f-b03d-5e10d47ccddb" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:20 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-e769e53d-cf86-46b0-bf7a-eff337f50086 tempest-ProjectReaderTests-1682954090 None] Deleting offline snapshot f7eb8895-8490-4b9f-b03d-5e10d47ccddb of volume 56709d53-12cc-43b6-b259-1d26c1636be2 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:32:20 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-e769e53d-cf86-46b0-bf7a-eff337f50086 tempest-ProjectReaderTests-1682954090 None] snapshot_file for this snap is: volume-56709d53-12cc-43b6-b259-1d26c1636be2.f7eb8895-8490-4b9f-b03d-5e10d47ccddb {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:32:20 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa42f83-dc25-44a0-af3f-512a94183b35]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:32:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e769e53d-cf86-46b0-bf7a-eff337f50086 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2.f7eb8895-8490-4b9f-b03d-5e10d47ccddb {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:20 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d6a8b0bf-ed16-4bd2-878c-b82e87dc0165 tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e" returned: 0 in 1.045s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d6a8b0bf-ed16-4bd2-878c-b82e87dc0165 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e.35531383-a8d7-4331-b56a-dc2fdfc8034c 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:20 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2.f7eb8895-8490-4b9f-b03d-5e10d47ccddb Jul 10 18:32:20 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:20 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e.35531383-a8d7-4331-b56a-dc2fdfc8034c 1G Jul 10 18:32:20 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:20 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b1f81c69-aa82-4df4-b0e7-1c616d0f1666 tempest-CinderUnicodeTest-806353781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2a1f6f7-d4c2-462e-a42d-08a0df4a0318" returned: 0 in 0.945s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b1f81c69-aa82-4df4-b0e7-1c616d0f1666 tempest-CinderUnicodeTest-806353781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2a1f6f7-d4c2-462e-a42d-08a0df4a0318 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:20 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2a1f6f7-d4c2-462e-a42d-08a0df4a0318 Jul 10 18:32:20 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:21 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e769e53d-cf86-46b0-bf7a-eff337f50086 tempest-ProjectReaderTests-1682954090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2.f7eb8895-8490-4b9f-b03d-5e10d47ccddb" returned: 0 in 0.979s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:21 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-e769e53d-cf86-46b0-bf7a-eff337f50086 tempest-ProjectReaderTests-1682954090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56709d53-12cc-43b6-b259-1d26c1636be2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:32:21 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f167496-9f71-4040-820e-8172c3bcaf8f]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:32:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e769e53d-cf86-46b0-bf7a-eff337f50086 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:21 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d6a8b0bf-ed16-4bd2-878c-b82e87dc0165 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e.35531383-a8d7-4331-b56a-dc2fdfc8034c 1G" returned: 0 in 0.972s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d6a8b0bf-ed16-4bd2-878c-b82e87dc0165 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1762542-8f74-45e6-8a58-6fb124a5d87e -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e.35531383-a8d7-4331-b56a-dc2fdfc8034c {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:21 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1762542-8f74-45e6-8a58-6fb124a5d87e -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e.35531383-a8d7-4331-b56a-dc2fdfc8034c Jul 10 18:32:21 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:21 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2 Jul 10 18:32:21 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:21 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b1f81c69-aa82-4df4-b0e7-1c616d0f1666 tempest-CinderUnicodeTest-806353781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b2a1f6f7-d4c2-462e-a42d-08a0df4a0318" returned: 0 in 0.759s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:21 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b1f81c69-aa82-4df4-b0e7-1c616d0f1666 tempest-CinderUnicodeTest-806353781 None] Lock "cinder-quobyte-b2a1f6f7-d4c2-462e-a42d-08a0df4a0318" released by "delete_volume" :: held 1.774s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:21 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-b1f81c69-aa82-4df4-b0e7-1c616d0f1666 tempest-CinderUnicodeTest-806353781 None] Created reservations ['0e0bf3cd-185e-4aec-a482-4d5f90327f7b', '71dba9c6-775d-42f1-b71c-7e9f426c40bb', 'ed525dc6-f21f-47a5-90aa-eff1b42ecdbb', 'e74e4911-e39e-4ad6-97a3-02588ed75cde'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:32:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b1f81c69-aa82-4df4-b0e7-1c616d0f1666 tempest-CinderUnicodeTest-806353781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:32:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b1f81c69-aa82-4df4-b0e7-1c616d0f1666 tempest-CinderUnicodeTest-806353781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:32:21 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b1f81c69-aa82-4df4-b0e7-1c616d0f1666 tempest-CinderUnicodeTest-806353781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:32:21 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b1f81c69-aa82-4df4-b0e7-1c616d0f1666 tempest-CinderUnicodeTest-806353781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:32:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b1f81c69-aa82-4df4-b0e7-1c616d0f1666 tempest-CinderUnicodeTest-806353781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:32:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b1f81c69-aa82-4df4-b0e7-1c616d0f1666 tempest-CinderUnicodeTest-806353781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:21 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:32:21 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:22 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e769e53d-cf86-46b0-bf7a-eff337f50086 tempest-ProjectReaderTests-1682954090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2" returned: 0 in 0.947s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e769e53d-cf86-46b0-bf7a-eff337f50086 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2.f7eb8895-8490-4b9f-b03d-5e10d47ccddb {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:22 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d6a8b0bf-ed16-4bd2-878c-b82e87dc0165 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1762542-8f74-45e6-8a58-6fb124a5d87e -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e.35531383-a8d7-4331-b56a-dc2fdfc8034c" returned: 0 in 0.912s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:22 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-d6a8b0bf-ed16-4bd2-878c-b82e87dc0165 tempest-ProjectMemberTests-1041831846 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e.35531383-a8d7-4331-b56a-dc2fdfc8034c is being set with open permissions: ugo+rw Jul 10 18:32:22 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2.f7eb8895-8490-4b9f-b03d-5e10d47ccddb Jul 10 18:32:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d6a8b0bf-ed16-4bd2-878c-b82e87dc0165 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e.35531383-a8d7-4331-b56a-dc2fdfc8034c {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:22 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:22 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e.35531383-a8d7-4331-b56a-dc2fdfc8034c Jul 10 18:32:22 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:22 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b1f81c69-aa82-4df4-b0e7-1c616d0f1666 tempest-CinderUnicodeTest-806353781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.893s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:22 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-b1f81c69-aa82-4df4-b0e7-1c616d0f1666 tempest-CinderUnicodeTest-806353781 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:32:22 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-b1f81c69-aa82-4df4-b0e7-1c616d0f1666 tempest-CinderUnicodeTest-806353781 None] Deleted volume successfully. Jul 10 18:32:22 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b1f81c69-aa82-4df4-b0e7-1c616d0f1666 tempest-CinderUnicodeTest-806353781 None] Lock "cinder-b2a1f6f7-d4c2-462e-a42d-08a0df4a0318-delete_volume" released by "delete_volume" :: held 3.018s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:23 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d6a8b0bf-ed16-4bd2-878c-b82e87dc0165 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e.35531383-a8d7-4331-b56a-dc2fdfc8034c" returned: 0 in 0.837s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:23 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e769e53d-cf86-46b0-bf7a-eff337f50086 tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2.f7eb8895-8490-4b9f-b03d-5e10d47ccddb" returned: 0 in 0.918s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e769e53d-cf86-46b0-bf7a-eff337f50086 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2.f7eb8895-8490-4b9f-b03d-5e10d47ccddb {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d6a8b0bf-ed16-4bd2-878c-b82e87dc0165 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:23 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2.f7eb8895-8490-4b9f-b03d-5e10d47ccddb Jul 10 18:32:23 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:23 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e.info Jul 10 18:32:23 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:23 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e769e53d-cf86-46b0-bf7a-eff337f50086 tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2.f7eb8895-8490-4b9f-b03d-5e10d47ccddb" returned: 0 in 0.747s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:23 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d6a8b0bf-ed16-4bd2-878c-b82e87dc0165 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e.info" returned: 0 in 0.767s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:23 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-d6a8b0bf-ed16-4bd2-878c-b82e87dc0165 tempest-ProjectMemberTests-1041831846 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e.info is being set with open permissions: ugo+rw Jul 10 18:32:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d6a8b0bf-ed16-4bd2-878c-b82e87dc0165 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:23 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e769e53d-cf86-46b0-bf7a-eff337f50086 tempest-ProjectReaderTests-1682954090 None] Lock "cinder-quobyte-f7eb8895-8490-4b9f-b03d-5e10d47ccddb" released by "_delete_snapshot" :: held 3.724s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:23 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e769e53d-cf86-46b0-bf7a-eff337f50086 tempest-ProjectReaderTests-1682954090 None] Lock "cinder-quobyte-56709d53-12cc-43b6-b259-1d26c1636be2" released by "delete_snapshot" :: held 3.755s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:23 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e.info Jul 10 18:32:23 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:23 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-e769e53d-cf86-46b0-bf7a-eff337f50086 tempest-ProjectReaderTests-1682954090 None] Created reservations ['b8d51118-02b1-402d-8ad2-c2a594ea2893', 'cdb3bfff-4047-4f4b-b133-d330d492a982', '7d0794fc-716f-45e3-bac7-cc16f309f724', 'c7d568ca-c0c3-485b-b481-2c0104d5d3c7'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:32:24 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-e769e53d-cf86-46b0-bf7a-eff337f50086 tempest-ProjectReaderTests-1682954090 None] Delete snapshot completed successfully. Jul 10 18:32:24 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e769e53d-cf86-46b0-bf7a-eff337f50086 tempest-ProjectReaderTests-1682954090 None] Lock "cinder-f7eb8895-8490-4b9f-b03d-5e10d47ccddb-delete_snapshot" released by "delete_snapshot" :: held 3.958s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:24 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8b4bf531-ef78-4d09-9de6-b40eb38326e2 tempest-ProjectReaderTests-1682954090 None] Acquiring lock "cinder-56709d53-12cc-43b6-b259-1d26c1636be2-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:24 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8b4bf531-ef78-4d09-9de6-b40eb38326e2 tempest-ProjectReaderTests-1682954090 None] Lock "cinder-56709d53-12cc-43b6-b259-1d26c1636be2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:24 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8b4bf531-ef78-4d09-9de6-b40eb38326e2 tempest-ProjectReaderTests-1682954090 None] Acquiring lock "cinder-quobyte-56709d53-12cc-43b6-b259-1d26c1636be2" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:24 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8b4bf531-ef78-4d09-9de6-b40eb38326e2 tempest-ProjectReaderTests-1682954090 None] Lock "cinder-quobyte-56709d53-12cc-43b6-b259-1d26c1636be2" acquired by "delete_volume" :: waited 0.028s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:24 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[59eab8a0-f05b-4176-a6e6-72b8d02aa916]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:32:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8b4bf531-ef78-4d09-9de6-b40eb38326e2 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:24 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2 Jul 10 18:32:24 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:24 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d6a8b0bf-ed16-4bd2-878c-b82e87dc0165 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e.info" returned: 0 in 0.912s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d6a8b0bf-ed16-4bd2-878c-b82e87dc0165 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.572s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:32:24 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-d6a8b0bf-ed16-4bd2-878c-b82e87dc0165 tempest-ProjectMemberTests-1041831846 None] Create snapshot completed successfully Jul 10 18:32:25 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-22ba5242-5cd3-4295-87cb-2b091d7b989d tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-35531383-a8d7-4331-b56a-dc2fdfc8034c-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:25 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-22ba5242-5cd3-4295-87cb-2b091d7b989d tempest-ProjectMemberTests-1041831846 None] Lock "cinder-35531383-a8d7-4331-b56a-dc2fdfc8034c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:25 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-22ba5242-5cd3-4295-87cb-2b091d7b989d tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-quobyte-a1762542-8f74-45e6-8a58-6fb124a5d87e" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:25 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-22ba5242-5cd3-4295-87cb-2b091d7b989d tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-a1762542-8f74-45e6-8a58-6fb124a5d87e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:25 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-22ba5242-5cd3-4295-87cb-2b091d7b989d tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-quobyte-35531383-a8d7-4331-b56a-dc2fdfc8034c" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:25 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-22ba5242-5cd3-4295-87cb-2b091d7b989d tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-35531383-a8d7-4331-b56a-dc2fdfc8034c" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:25 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-22ba5242-5cd3-4295-87cb-2b091d7b989d tempest-ProjectMemberTests-1041831846 None] Deleting offline snapshot 35531383-a8d7-4331-b56a-dc2fdfc8034c of volume a1762542-8f74-45e6-8a58-6fb124a5d87e {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:32:25 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-22ba5242-5cd3-4295-87cb-2b091d7b989d tempest-ProjectMemberTests-1041831846 None] snapshot_file for this snap is: volume-a1762542-8f74-45e6-8a58-6fb124a5d87e.35531383-a8d7-4331-b56a-dc2fdfc8034c {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:32:25 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8b4bf531-ef78-4d09-9de6-b40eb38326e2 tempest-ProjectReaderTests-1682954090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2" returned: 0 in 0.961s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8b4bf531-ef78-4d09-9de6-b40eb38326e2 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:25 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1375ba7-7c83-4605-ad10-5fb454de4af3]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:32:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-22ba5242-5cd3-4295-87cb-2b091d7b989d tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e.35531383-a8d7-4331-b56a-dc2fdfc8034c {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:25 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2 Jul 10 18:32:25 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:25 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e.35531383-a8d7-4331-b56a-dc2fdfc8034c Jul 10 18:32:25 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:26 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8b4bf531-ef78-4d09-9de6-b40eb38326e2 tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-56709d53-12cc-43b6-b259-1d26c1636be2" returned: 0 in 0.699s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:26 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8b4bf531-ef78-4d09-9de6-b40eb38326e2 tempest-ProjectReaderTests-1682954090 None] Lock "cinder-quobyte-56709d53-12cc-43b6-b259-1d26c1636be2" released by "delete_volume" :: held 1.765s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:26 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-8b4bf531-ef78-4d09-9de6-b40eb38326e2 tempest-ProjectReaderTests-1682954090 None] Created reservations ['c34d0135-95cb-41fb-992b-19f689ae33fe', 'c22281b0-3cbb-49c2-8430-f3cc424ace4d', '753c7bf7-7934-4764-b951-cf3165f3ee2d', 'aabc5524-1655-42c4-9df7-d2be083ea0ba'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:32:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8b4bf531-ef78-4d09-9de6-b40eb38326e2 tempest-ProjectReaderTests-1682954090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:32:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8b4bf531-ef78-4d09-9de6-b40eb38326e2 tempest-ProjectReaderTests-1682954090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:32:26 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8b4bf531-ef78-4d09-9de6-b40eb38326e2 tempest-ProjectReaderTests-1682954090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:32:26 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8b4bf531-ef78-4d09-9de6-b40eb38326e2 tempest-ProjectReaderTests-1682954090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:32:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8b4bf531-ef78-4d09-9de6-b40eb38326e2 tempest-ProjectReaderTests-1682954090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:32:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8b4bf531-ef78-4d09-9de6-b40eb38326e2 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:26 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-22ba5242-5cd3-4295-87cb-2b091d7b989d tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e.35531383-a8d7-4331-b56a-dc2fdfc8034c" returned: 0 in 0.923s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:26 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-22ba5242-5cd3-4295-87cb-2b091d7b989d tempest-ProjectMemberTests-1041831846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1762542-8f74-45e6-8a58-6fb124a5d87e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:32:26 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:32:26 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:26 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ce54d1-46a7-4bc1-808d-5be92ca092b2]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:32:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-22ba5242-5cd3-4295-87cb-2b091d7b989d tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:26 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e Jul 10 18:32:26 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:27 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8b4bf531-ef78-4d09-9de6-b40eb38326e2 tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.740s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:27 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-8b4bf531-ef78-4d09-9de6-b40eb38326e2 tempest-ProjectReaderTests-1682954090 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:32:27 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-8b4bf531-ef78-4d09-9de6-b40eb38326e2 tempest-ProjectReaderTests-1682954090 None] Deleted volume successfully. Jul 10 18:32:27 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:27 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8b4bf531-ef78-4d09-9de6-b40eb38326e2 tempest-ProjectReaderTests-1682954090 None] Lock "cinder-56709d53-12cc-43b6-b259-1d26c1636be2-delete_volume" released by "delete_volume" :: held 2.979s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-22ba5242-5cd3-4295-87cb-2b091d7b989d tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e" returned: 0 in 0.889s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-22ba5242-5cd3-4295-87cb-2b091d7b989d tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e.35531383-a8d7-4331-b56a-dc2fdfc8034c {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:27 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e.35531383-a8d7-4331-b56a-dc2fdfc8034c Jul 10 18:32:27 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:28 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-22ba5242-5cd3-4295-87cb-2b091d7b989d tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e.35531383-a8d7-4331-b56a-dc2fdfc8034c" returned: 0 in 0.750s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-22ba5242-5cd3-4295-87cb-2b091d7b989d tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e.35531383-a8d7-4331-b56a-dc2fdfc8034c {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:28 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e.35531383-a8d7-4331-b56a-dc2fdfc8034c Jul 10 18:32:28 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:28 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:32:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] Flow 'volume_create_manager' (083bba5a-6265-4f55-aa01-cdb9f5373ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:32:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ffb2c86-b0e3-4507-9d9d-89f50e497995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ffb2c86-b0e3-4507-9d9d-89f50e497995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1814822116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2de0c801-aa0a-415d-8089-a58cb216990b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='935a1657e6614ac3a2269f04e097247e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:32:28Z,use_quota=True,user_id='bf797658fda948239bec7f0bcb759bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (149908a2-76f1-47a5-a5c8-2a2e8029ab58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (149908a2-76f1-47a5-a5c8-2a2e8029ab58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac4a18f-c30a-4937-8747-b4dfecb11d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dac4a18f-c30a-4937-8747-b4dfecb11d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2de0c801-aa0a-415d-8089-a58cb216990b', 'volume_name': 'volume-2de0c801-aa0a-415d-8089-a58cb216990b', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a63eaa04-ac53-4f5a-9ea1-e3b52184036c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a63eaa04-ac53-4f5a-9ea1-e3b52184036c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:28 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0da8d1dd-afc1-453d-81b4-88ee687ee48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:28 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] Volume 2de0c801-aa0a-415d-8089-a58cb216990b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2de0c801-aa0a-415d-8089-a58cb216990b', 'volume_size': 1} Jul 10 18:32:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:32:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:32:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1814822116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2de0c801-aa0a-415d-8089-a58cb216990b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='935a1657e6614ac3a2269f04e097247e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:32:28Z,use_quota=True,user_id='bf797658fda948239bec7f0bcb759bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:32:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] Creating volume 2de0c801-aa0a-415d-8089-a58cb216990b {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:32:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:32:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:32:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:32:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:32:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:32:28 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:32:28 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:32:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:28 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b 1073741824 Jul 10 18:32:28 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:28 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-22ba5242-5cd3-4295-87cb-2b091d7b989d tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e.35531383-a8d7-4331-b56a-dc2fdfc8034c" returned: 0 in 0.666s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:28 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-22ba5242-5cd3-4295-87cb-2b091d7b989d tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-35531383-a8d7-4331-b56a-dc2fdfc8034c" released by "_delete_snapshot" :: held 3.405s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:28 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-22ba5242-5cd3-4295-87cb-2b091d7b989d tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-a1762542-8f74-45e6-8a58-6fb124a5d87e" released by "delete_snapshot" :: held 3.445s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:29 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-22ba5242-5cd3-4295-87cb-2b091d7b989d tempest-ProjectMemberTests-1041831846 None] Created reservations ['098a20cb-acb4-43a4-baeb-f17f2a326037', '283d0ab0-e8ef-4e40-b77d-62afe283e3f4', 'fd7048ad-0e57-41ec-b95c-99ca2ebce072', '3beadd30-269d-4d0c-ba52-079634f1274d'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:32:29 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-22ba5242-5cd3-4295-87cb-2b091d7b989d tempest-ProjectMemberTests-1041831846 None] Delete snapshot completed successfully. Jul 10 18:32:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-22ba5242-5cd3-4295-87cb-2b091d7b989d tempest-ProjectMemberTests-1041831846 None] Lock "cinder-35531383-a8d7-4331-b56a-dc2fdfc8034c-delete_snapshot" released by "delete_snapshot" :: held 4.080s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:29 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b 1073741824" returned: 0 in 0.948s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:29 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b Jul 10 18:32:29 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5e02afed-9d95-451d-bb2f-ff5d4638dd3c tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-a1762542-8f74-45e6-8a58-6fb124a5d87e-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5e02afed-9d95-451d-bb2f-ff5d4638dd3c tempest-ProjectMemberTests-1041831846 None] Lock "cinder-a1762542-8f74-45e6-8a58-6fb124a5d87e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:30 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5e02afed-9d95-451d-bb2f-ff5d4638dd3c tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-quobyte-a1762542-8f74-45e6-8a58-6fb124a5d87e" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:30 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5e02afed-9d95-451d-bb2f-ff5d4638dd3c tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-a1762542-8f74-45e6-8a58-6fb124a5d87e" acquired by "delete_volume" :: waited 0.020s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:30 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[1619b74f-3d48-433e-86e7-082792f644c1]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:32:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5e02afed-9d95-451d-bb2f-ff5d4638dd3c tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:30 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b" returned: 0 in 0.752s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:30 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] <== create_volume: return (1938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:32:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.942s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:32:30 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e Jul 10 18:32:30 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:30 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0da8d1dd-afc1-453d-81b4-88ee687ee48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2de0c801-aa0a-415d-8089-a58cb216990b', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:30 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f496b8ec-c41e-4260-97bb-fd6bb14e6a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:30 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] Volume volume-2de0c801-aa0a-415d-8089-a58cb216990b (2de0c801-aa0a-415d-8089-a58cb216990b): created successfully Jul 10 18:32:30 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f496b8ec-c41e-4260-97bb-fd6bb14e6a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:30 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] Flow 'volume_create_manager' (083bba5a-6265-4f55-aa01-cdb9f5373ab1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:32:30 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-f8ca7dc9-9525-4fd0-a58b-6e809bc9bc23 tempest-ProjectReaderTests-1682954090 None] Created volume successfully. Jul 10 18:32:31 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5e02afed-9d95-451d-bb2f-ff5d4638dd3c tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e" returned: 0 in 0.819s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5e02afed-9d95-451d-bb2f-ff5d4638dd3c tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:31 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e Jul 10 18:32:31 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:32 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5e02afed-9d95-451d-bb2f-ff5d4638dd3c tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-a1762542-8f74-45e6-8a58-6fb124a5d87e" returned: 0 in 0.659s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:32 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5e02afed-9d95-451d-bb2f-ff5d4638dd3c tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-a1762542-8f74-45e6-8a58-6fb124a5d87e" released by "delete_volume" :: held 1.552s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:32 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-5e02afed-9d95-451d-bb2f-ff5d4638dd3c tempest-ProjectMemberTests-1041831846 None] Created reservations ['94dd5e59-d650-4f87-aa15-b95826471d36', 'd448cbc3-57ff-4122-a2da-12e4771f575a', '8b9a09e3-38cb-496e-aa5d-5e311a90d1a0', 'fa98c96b-61b9-463a-a5e5-383fb7c878cb'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:32:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-eea448e6-037b-4679-ad60-1eb32501ba67 tempest-ProjectReaderTests-1682954090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:32:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-eea448e6-037b-4679-ad60-1eb32501ba67 tempest-ProjectReaderTests-1682954090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:32:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-eea448e6-037b-4679-ad60-1eb32501ba67 tempest-ProjectReaderTests-1682954090 None] Creating offline snapshot 5d5f0efd-ce9c-4a35-91bf-6c24dbbc271d of volume 2de0c801-aa0a-415d-8089-a58cb216990b {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:32:32 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8ff111-8f17-4bdf-9281-7485575c5bb5]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:32:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-eea448e6-037b-4679-ad60-1eb32501ba67 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5e02afed-9d95-451d-bb2f-ff5d4638dd3c tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:32:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5e02afed-9d95-451d-bb2f-ff5d4638dd3c tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:32:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5e02afed-9d95-451d-bb2f-ff5d4638dd3c tempest-ProjectMemberTests-1041831846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:32:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5e02afed-9d95-451d-bb2f-ff5d4638dd3c tempest-ProjectMemberTests-1041831846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:32:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5e02afed-9d95-451d-bb2f-ff5d4638dd3c tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:32:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5e02afed-9d95-451d-bb2f-ff5d4638dd3c tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:32 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:32:32 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:32 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b Jul 10 18:32:32 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:33 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5e02afed-9d95-451d-bb2f-ff5d4638dd3c tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.941s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:33 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-5e02afed-9d95-451d-bb2f-ff5d4638dd3c tempest-ProjectMemberTests-1041831846 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:32:33 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-5e02afed-9d95-451d-bb2f-ff5d4638dd3c tempest-ProjectMemberTests-1041831846 None] Deleted volume successfully. Jul 10 18:32:33 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5e02afed-9d95-451d-bb2f-ff5d4638dd3c tempest-ProjectMemberTests-1041831846 None] Lock "cinder-a1762542-8f74-45e6-8a58-6fb124a5d87e-delete_volume" released by "delete_volume" :: held 3.887s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:34 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-eea448e6-037b-4679-ad60-1eb32501ba67 tempest-ProjectReaderTests-1682954090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b" returned: 0 in 1.370s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-eea448e6-037b-4679-ad60-1eb32501ba67 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b.5d5f0efd-ce9c-4a35-91bf-6c24dbbc271d 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:34 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b.5d5f0efd-ce9c-4a35-91bf-6c24dbbc271d 1G Jul 10 18:32:34 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:34 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:32:34 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] Flow 'volume_create_manager' (e1f452dc-1927-44b9-9d95-b50093bb3197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:32:34 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99c82563-0584-4b26-a568-9e1503f852af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:34 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99c82563-0584-4b26-a568-9e1503f852af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1620383009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d447913-6eaf-4b4f-a8c4-47ebca655e5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab5573a169b463e9ccae9d5c832530c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:32:34Z,use_quota=True,user_id='db9bc81f72324f5da33633fdc460fbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:34 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f378b3e-6e11-42df-9fff-432368651867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:34 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f378b3e-6e11-42df-9fff-432368651867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:34 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353dda1b-74df-4064-82b8-835b1c16cdd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:34 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353dda1b-74df-4064-82b8-835b1c16cdd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d447913-6eaf-4b4f-a8c4-47ebca655e5f', 'volume_name': 'volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:34 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc9cea6-ab62-40d3-85fb-42e89d31203e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:34 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdc9cea6-ab62-40d3-85fb-42e89d31203e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:34 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c52d072-9438-4257-b2de-6ebbefd2fe5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:34 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] Volume 4d447913-6eaf-4b4f-a8c4-47ebca655e5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f', 'volume_size': 1} Jul 10 18:32:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:32:35 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-eea448e6-037b-4679-ad60-1eb32501ba67 tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b.5d5f0efd-ce9c-4a35-91bf-6c24dbbc271d 1G" returned: 0 in 1.219s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-eea448e6-037b-4679-ad60-1eb32501ba67 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2de0c801-aa0a-415d-8089-a58cb216990b -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b.5d5f0efd-ce9c-4a35-91bf-6c24dbbc271d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:35 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2de0c801-aa0a-415d-8089-a58cb216990b -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b.5d5f0efd-ce9c-4a35-91bf-6c24dbbc271d Jul 10 18:32:35 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:36 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-eea448e6-037b-4679-ad60-1eb32501ba67 tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2de0c801-aa0a-415d-8089-a58cb216990b -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b.5d5f0efd-ce9c-4a35-91bf-6c24dbbc271d" returned: 0 in 0.871s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:36 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-eea448e6-037b-4679-ad60-1eb32501ba67 tempest-ProjectReaderTests-1682954090 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b.5d5f0efd-ce9c-4a35-91bf-6c24dbbc271d is being set with open permissions: ugo+rw Jul 10 18:32:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-eea448e6-037b-4679-ad60-1eb32501ba67 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b.5d5f0efd-ce9c-4a35-91bf-6c24dbbc271d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:36 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b.5d5f0efd-ce9c-4a35-91bf-6c24dbbc271d Jul 10 18:32:36 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:36 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-eea448e6-037b-4679-ad60-1eb32501ba67 tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b.5d5f0efd-ce9c-4a35-91bf-6c24dbbc271d" returned: 0 in 0.722s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-eea448e6-037b-4679-ad60-1eb32501ba67 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:36 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b.info Jul 10 18:32:36 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:37 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-eea448e6-037b-4679-ad60-1eb32501ba67 tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b.info" returned: 0 in 0.742s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:37 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-eea448e6-037b-4679-ad60-1eb32501ba67 tempest-ProjectReaderTests-1682954090 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b.info is being set with open permissions: ugo+rw Jul 10 18:32:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-eea448e6-037b-4679-ad60-1eb32501ba67 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:37 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b.info Jul 10 18:32:37 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:38 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-eea448e6-037b-4679-ad60-1eb32501ba67 tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b.info" returned: 0 in 0.842s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-eea448e6-037b-4679-ad60-1eb32501ba67 tempest-ProjectReaderTests-1682954090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.961s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:32:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.194s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:32:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1620383009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d447913-6eaf-4b4f-a8c4-47ebca655e5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab5573a169b463e9ccae9d5c832530c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:32:34Z,use_quota=True,user_id='db9bc81f72324f5da33633fdc460fbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:32:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] Creating volume 4d447913-6eaf-4b4f-a8c4-47ebca655e5f {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:32:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:32:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:32:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:32:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:32:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:32:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:32:38 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:32:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:38 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-eea448e6-037b-4679-ad60-1eb32501ba67 tempest-ProjectReaderTests-1682954090 None] Create snapshot completed successfully Jul 10 18:32:38 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f 1073741824 Jul 10 18:32:38 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:38 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f46a6d8c-5949-4734-863c-c151c9783e54 tempest-ProjectReaderTests-1682954090 None] Acquiring lock "cinder-5d5f0efd-ce9c-4a35-91bf-6c24dbbc271d-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:38 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f46a6d8c-5949-4734-863c-c151c9783e54 tempest-ProjectReaderTests-1682954090 None] Lock "cinder-5d5f0efd-ce9c-4a35-91bf-6c24dbbc271d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:38 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f46a6d8c-5949-4734-863c-c151c9783e54 tempest-ProjectReaderTests-1682954090 None] Acquiring lock "cinder-quobyte-2de0c801-aa0a-415d-8089-a58cb216990b" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:39 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f46a6d8c-5949-4734-863c-c151c9783e54 tempest-ProjectReaderTests-1682954090 None] Lock "cinder-quobyte-2de0c801-aa0a-415d-8089-a58cb216990b" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:39 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f46a6d8c-5949-4734-863c-c151c9783e54 tempest-ProjectReaderTests-1682954090 None] Acquiring lock "cinder-quobyte-5d5f0efd-ce9c-4a35-91bf-6c24dbbc271d" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:39 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f46a6d8c-5949-4734-863c-c151c9783e54 tempest-ProjectReaderTests-1682954090 None] Lock "cinder-quobyte-5d5f0efd-ce9c-4a35-91bf-6c24dbbc271d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:39 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-f46a6d8c-5949-4734-863c-c151c9783e54 tempest-ProjectReaderTests-1682954090 None] Deleting offline snapshot 5d5f0efd-ce9c-4a35-91bf-6c24dbbc271d of volume 2de0c801-aa0a-415d-8089-a58cb216990b {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:32:39 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-f46a6d8c-5949-4734-863c-c151c9783e54 tempest-ProjectReaderTests-1682954090 None] snapshot_file for this snap is: volume-2de0c801-aa0a-415d-8089-a58cb216990b.5d5f0efd-ce9c-4a35-91bf-6c24dbbc271d {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:32:39 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a91dba1-30c1-4d42-b898-b173bc7b5531]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:32:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f46a6d8c-5949-4734-863c-c151c9783e54 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b.5d5f0efd-ce9c-4a35-91bf-6c24dbbc271d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:39 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b.5d5f0efd-ce9c-4a35-91bf-6c24dbbc271d Jul 10 18:32:39 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:39 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f 1073741824" returned: 0 in 1.191s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:39 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f Jul 10 18:32:39 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:40 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f46a6d8c-5949-4734-863c-c151c9783e54 tempest-ProjectReaderTests-1682954090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b.5d5f0efd-ce9c-4a35-91bf-6c24dbbc271d" returned: 0 in 1.123s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:40 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-f46a6d8c-5949-4734-863c-c151c9783e54 tempest-ProjectReaderTests-1682954090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2de0c801-aa0a-415d-8089-a58cb216990b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:32:40 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[adadfec7-095b-4b19-97d8-ea497ddff8d5]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:32:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f46a6d8c-5949-4734-863c-c151c9783e54 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:40 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b Jul 10 18:32:40 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:40 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f" returned: 0 in 0.845s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:40 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] <== create_volume: return (2092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:32:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.095s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:32:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c52d072-9438-4257-b2de-6ebbefd2fe5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a307943-d505-4ad2-96d5-ee2585caedde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:40 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] Volume volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f (4d447913-6eaf-4b4f-a8c4-47ebca655e5f): created successfully Jul 10 18:32:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a307943-d505-4ad2-96d5-ee2585caedde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:40 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] Flow 'volume_create_manager' (e1f452dc-1927-44b9-9d95-b50093bb3197) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:32:40 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-76ccfc58-2e1d-47e0-aaa6-23531eee0910 tempest-ProjectMemberTests-1041831846 None] Created volume successfully. Jul 10 18:32:41 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f46a6d8c-5949-4734-863c-c151c9783e54 tempest-ProjectReaderTests-1682954090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b" returned: 0 in 0.974s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f46a6d8c-5949-4734-863c-c151c9783e54 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b.5d5f0efd-ce9c-4a35-91bf-6c24dbbc271d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:41 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b.5d5f0efd-ce9c-4a35-91bf-6c24dbbc271d Jul 10 18:32:41 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3530c164-2d2b-4ef6-aed1-6b5727035690 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:32:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3530c164-2d2b-4ef6-aed1-6b5727035690 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:32:42 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-3530c164-2d2b-4ef6-aed1-6b5727035690 tempest-ProjectMemberTests-1041831846 None] Creating offline snapshot 18adce35-de22-4e09-8fa5-a674f6000576 of volume 4d447913-6eaf-4b4f-a8c4-47ebca655e5f {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:32:42 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6b1eb2-e013-43e1-8011-2c91890a1304]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:32:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3530c164-2d2b-4ef6-aed1-6b5727035690 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:42 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f Jul 10 18:32:42 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:42 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f46a6d8c-5949-4734-863c-c151c9783e54 tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b.5d5f0efd-ce9c-4a35-91bf-6c24dbbc271d" returned: 0 in 0.964s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f46a6d8c-5949-4734-863c-c151c9783e54 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b.5d5f0efd-ce9c-4a35-91bf-6c24dbbc271d {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:42 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b.5d5f0efd-ce9c-4a35-91bf-6c24dbbc271d Jul 10 18:32:42 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:43 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f46a6d8c-5949-4734-863c-c151c9783e54 tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b.5d5f0efd-ce9c-4a35-91bf-6c24dbbc271d" returned: 0 in 0.843s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:43 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f46a6d8c-5949-4734-863c-c151c9783e54 tempest-ProjectReaderTests-1682954090 None] Lock "cinder-quobyte-5d5f0efd-ce9c-4a35-91bf-6c24dbbc271d" released by "_delete_snapshot" :: held 4.028s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:43 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f46a6d8c-5949-4734-863c-c151c9783e54 tempest-ProjectReaderTests-1682954090 None] Lock "cinder-quobyte-2de0c801-aa0a-415d-8089-a58cb216990b" released by "delete_snapshot" :: held 4.062s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:43 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3530c164-2d2b-4ef6-aed1-6b5727035690 tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f" returned: 0 in 1.067s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3530c164-2d2b-4ef6-aed1-6b5727035690 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f.18adce35-de22-4e09-8fa5-a674f6000576 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:43 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f.18adce35-de22-4e09-8fa5-a674f6000576 1G Jul 10 18:32:43 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:43 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-f46a6d8c-5949-4734-863c-c151c9783e54 tempest-ProjectReaderTests-1682954090 None] Created reservations ['0ac50bc5-b937-469c-bd6f-4581230a31d1', '1e1dc1bf-52cc-4747-a096-e82e09d34931', '3eebd634-7f59-40a7-8387-e7d2ebb470ac', 'aeeed3c6-12d9-4429-b2d4-e220e67a8c57'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:32:43 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-f46a6d8c-5949-4734-863c-c151c9783e54 tempest-ProjectReaderTests-1682954090 None] Delete snapshot completed successfully. Jul 10 18:32:43 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f46a6d8c-5949-4734-863c-c151c9783e54 tempest-ProjectReaderTests-1682954090 None] Lock "cinder-5d5f0efd-ce9c-4a35-91bf-6c24dbbc271d-delete_snapshot" released by "delete_snapshot" :: held 4.293s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:43 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-62c94cc4-a1d6-4e83-a0dc-e6d9f93a95cc tempest-ProjectReaderTests-1682954090 None] Acquiring lock "cinder-2de0c801-aa0a-415d-8089-a58cb216990b-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:43 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-62c94cc4-a1d6-4e83-a0dc-e6d9f93a95cc tempest-ProjectReaderTests-1682954090 None] Lock "cinder-2de0c801-aa0a-415d-8089-a58cb216990b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:43 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-62c94cc4-a1d6-4e83-a0dc-e6d9f93a95cc tempest-ProjectReaderTests-1682954090 None] Acquiring lock "cinder-quobyte-2de0c801-aa0a-415d-8089-a58cb216990b" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:43 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-62c94cc4-a1d6-4e83-a0dc-e6d9f93a95cc tempest-ProjectReaderTests-1682954090 None] Lock "cinder-quobyte-2de0c801-aa0a-415d-8089-a58cb216990b" acquired by "delete_volume" :: waited 0.026s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:43 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ef366c-c6b5-4137-b1a2-be29a51bfb8d]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:32:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-62c94cc4-a1d6-4e83-a0dc-e6d9f93a95cc tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:43 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b Jul 10 18:32:43 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:44 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3530c164-2d2b-4ef6-aed1-6b5727035690 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f.18adce35-de22-4e09-8fa5-a674f6000576 1G" returned: 0 in 0.998s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3530c164-2d2b-4ef6-aed1-6b5727035690 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f.18adce35-de22-4e09-8fa5-a674f6000576 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:44 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f.18adce35-de22-4e09-8fa5-a674f6000576 Jul 10 18:32:44 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:44 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-62c94cc4-a1d6-4e83-a0dc-e6d9f93a95cc tempest-ProjectReaderTests-1682954090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b" returned: 0 in 0.961s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-62c94cc4-a1d6-4e83-a0dc-e6d9f93a95cc tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:44 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b Jul 10 18:32:44 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:44 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3530c164-2d2b-4ef6-aed1-6b5727035690 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f.18adce35-de22-4e09-8fa5-a674f6000576" returned: 0 in 0.890s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:45 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-3530c164-2d2b-4ef6-aed1-6b5727035690 tempest-ProjectMemberTests-1041831846 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f.18adce35-de22-4e09-8fa5-a674f6000576 is being set with open permissions: ugo+rw Jul 10 18:32:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3530c164-2d2b-4ef6-aed1-6b5727035690 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f.18adce35-de22-4e09-8fa5-a674f6000576 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:45 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f.18adce35-de22-4e09-8fa5-a674f6000576 Jul 10 18:32:45 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:45 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-62c94cc4-a1d6-4e83-a0dc-e6d9f93a95cc tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2de0c801-aa0a-415d-8089-a58cb216990b" returned: 0 in 0.874s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:45 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-62c94cc4-a1d6-4e83-a0dc-e6d9f93a95cc tempest-ProjectReaderTests-1682954090 None] Lock "cinder-quobyte-2de0c801-aa0a-415d-8089-a58cb216990b" released by "delete_volume" :: held 1.921s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:45 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-62c94cc4-a1d6-4e83-a0dc-e6d9f93a95cc tempest-ProjectReaderTests-1682954090 None] Created reservations ['68341d74-f385-4b41-b157-8e87bb801d0a', '02b7e444-5f5e-462a-95e7-197bee2c4ed1', '508b63a2-5d8c-42e8-92f7-51cbd0218bf1', 'df71d362-9458-451b-a480-0f08ffee5f83'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:32:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-62c94cc4-a1d6-4e83-a0dc-e6d9f93a95cc tempest-ProjectReaderTests-1682954090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:32:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-62c94cc4-a1d6-4e83-a0dc-e6d9f93a95cc tempest-ProjectReaderTests-1682954090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:32:45 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-62c94cc4-a1d6-4e83-a0dc-e6d9f93a95cc tempest-ProjectReaderTests-1682954090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:32:45 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-62c94cc4-a1d6-4e83-a0dc-e6d9f93a95cc tempest-ProjectReaderTests-1682954090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:32:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-62c94cc4-a1d6-4e83-a0dc-e6d9f93a95cc tempest-ProjectReaderTests-1682954090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:32:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-62c94cc4-a1d6-4e83-a0dc-e6d9f93a95cc tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:45 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:32:45 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:46 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3530c164-2d2b-4ef6-aed1-6b5727035690 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f.18adce35-de22-4e09-8fa5-a674f6000576" returned: 0 in 1.010s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3530c164-2d2b-4ef6-aed1-6b5727035690 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:46 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f.info Jul 10 18:32:46 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:46 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:32:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] Flow 'volume_create_manager' (732b4c4c-7584-4650-b0d4-98f9699fea81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:32:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d106db57-7d94-4fd4-8434-232d6781c197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d106db57-7d94-4fd4-8434-232d6781c197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1119684773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5e5bb7c-9ccb-46e7-9974-4756206cdf03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='935a1657e6614ac3a2269f04e097247e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:32:46Z,use_quota=True,user_id='bf797658fda948239bec7f0bcb759bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29588a27-db78-4a7f-b7f7-1c694c8d92e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29588a27-db78-4a7f-b7f7-1c694c8d92e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72b831b0-2f3b-4e82-aab1-3436d19ad95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72b831b0-2f3b-4e82-aab1-3436d19ad95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5e5bb7c-9ccb-46e7-9974-4756206cdf03', 'volume_name': 'volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04d9099e-82b4-4b34-a4fd-3cf5fe5f2546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04d9099e-82b4-4b34-a4fd-3cf5fe5f2546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:46 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ef76328-0934-45df-ab5e-67ecff5dcb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:46 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] Volume b5e5bb7c-9ccb-46e7-9974-4756206cdf03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03', 'volume_size': 1} Jul 10 18:32:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:32:46 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-62c94cc4-a1d6-4e83-a0dc-e6d9f93a95cc tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 1.016s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:46 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-62c94cc4-a1d6-4e83-a0dc-e6d9f93a95cc tempest-ProjectReaderTests-1682954090 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:32:46 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-62c94cc4-a1d6-4e83-a0dc-e6d9f93a95cc tempest-ProjectReaderTests-1682954090 None] Deleted volume successfully. Jul 10 18:32:46 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-62c94cc4-a1d6-4e83-a0dc-e6d9f93a95cc tempest-ProjectReaderTests-1682954090 None] Lock "cinder-2de0c801-aa0a-415d-8089-a58cb216990b-delete_volume" released by "delete_volume" :: held 3.328s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:47 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3530c164-2d2b-4ef6-aed1-6b5727035690 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f.info" returned: 0 in 0.938s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:47 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-3530c164-2d2b-4ef6-aed1-6b5727035690 tempest-ProjectMemberTests-1041831846 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f.info is being set with open permissions: ugo+rw Jul 10 18:32:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3530c164-2d2b-4ef6-aed1-6b5727035690 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:47 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f.info Jul 10 18:32:47 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:47 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3530c164-2d2b-4ef6-aed1-6b5727035690 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f.info" returned: 0 in 0.831s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3530c164-2d2b-4ef6-aed1-6b5727035690 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.868s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:32:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.313s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:32:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1119684773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5e5bb7c-9ccb-46e7-9974-4756206cdf03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='935a1657e6614ac3a2269f04e097247e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:32:46Z,use_quota=True,user_id='bf797658fda948239bec7f0bcb759bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:32:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] Creating volume b5e5bb7c-9ccb-46e7-9974-4756206cdf03 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:32:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:32:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:32:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:32:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:32:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:32:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:32:47 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:32:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:47 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03 1073741824 Jul 10 18:32:47 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:47 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-3530c164-2d2b-4ef6-aed1-6b5727035690 tempest-ProjectMemberTests-1041831846 None] Create snapshot completed successfully Jul 10 18:32:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-108841cf-31be-404a-8ee8-700fc39f1cc9 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-18adce35-de22-4e09-8fa5-a674f6000576-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-108841cf-31be-404a-8ee8-700fc39f1cc9 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-18adce35-de22-4e09-8fa5-a674f6000576-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-108841cf-31be-404a-8ee8-700fc39f1cc9 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-quobyte-4d447913-6eaf-4b4f-a8c4-47ebca655e5f" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-108841cf-31be-404a-8ee8-700fc39f1cc9 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-4d447913-6eaf-4b4f-a8c4-47ebca655e5f" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-108841cf-31be-404a-8ee8-700fc39f1cc9 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-quobyte-18adce35-de22-4e09-8fa5-a674f6000576" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-108841cf-31be-404a-8ee8-700fc39f1cc9 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-18adce35-de22-4e09-8fa5-a674f6000576" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:48 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-108841cf-31be-404a-8ee8-700fc39f1cc9 tempest-ProjectMemberTests-1041831846 None] Deleting offline snapshot 18adce35-de22-4e09-8fa5-a674f6000576 of volume 4d447913-6eaf-4b4f-a8c4-47ebca655e5f {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:32:48 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-108841cf-31be-404a-8ee8-700fc39f1cc9 tempest-ProjectMemberTests-1041831846 None] snapshot_file for this snap is: volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f.18adce35-de22-4e09-8fa5-a674f6000576 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:32:48 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b29de17-82bc-4534-acd8-e7dcebde4ae1]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:32:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-108841cf-31be-404a-8ee8-700fc39f1cc9 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f.18adce35-de22-4e09-8fa5-a674f6000576 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:48 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f.18adce35-de22-4e09-8fa5-a674f6000576 Jul 10 18:32:48 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:48 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03 1073741824" returned: 0 in 1.036s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:49 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03 Jul 10 18:32:49 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:49 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-108841cf-31be-404a-8ee8-700fc39f1cc9 tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f.18adce35-de22-4e09-8fa5-a674f6000576" returned: 0 in 1.022s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:49 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-108841cf-31be-404a-8ee8-700fc39f1cc9 tempest-ProjectMemberTests-1041831846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:32:49 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1d2122-8f39-4b52-a158-446f2e29a303]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:32:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-108841cf-31be-404a-8ee8-700fc39f1cc9 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:49 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f Jul 10 18:32:49 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:49 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03" returned: 0 in 0.994s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:49 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] <== create_volume: return (2090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:32:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.093s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:32:50 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ef76328-0934-45df-ab5e-67ecff5dcb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:50 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af6a5018-48e6-4af9-9d62-a6608a244ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:50 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] Volume volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03 (b5e5bb7c-9ccb-46e7-9974-4756206cdf03): created successfully Jul 10 18:32:50 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af6a5018-48e6-4af9-9d62-a6608a244ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:50 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] Flow 'volume_create_manager' (732b4c4c-7584-4650-b0d4-98f9699fea81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:32:50 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-9b5f933d-399d-47cc-b5eb-a33b440bff6c tempest-ProjectReaderTests-1682954090 None] Created volume successfully. Jul 10 18:32:50 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-108841cf-31be-404a-8ee8-700fc39f1cc9 tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f" returned: 0 in 1.018s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-108841cf-31be-404a-8ee8-700fc39f1cc9 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f.18adce35-de22-4e09-8fa5-a674f6000576 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:50 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f.18adce35-de22-4e09-8fa5-a674f6000576 Jul 10 18:32:50 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9778b404-7c32-4a01-be8b-57064ee65b5f tempest-ProjectReaderTests-1682954090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:32:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9778b404-7c32-4a01-be8b-57064ee65b5f tempest-ProjectReaderTests-1682954090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:32:51 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-9778b404-7c32-4a01-be8b-57064ee65b5f tempest-ProjectReaderTests-1682954090 None] Creating offline snapshot fe9344e7-8acf-41bb-9047-d4a1883222cc of volume b5e5bb7c-9ccb-46e7-9974-4756206cdf03 {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:32:51 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fdedad-e6fa-464f-9720-9be96003cd04]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:32:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9778b404-7c32-4a01-be8b-57064ee65b5f tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:51 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03 Jul 10 18:32:51 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:51 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-108841cf-31be-404a-8ee8-700fc39f1cc9 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f.18adce35-de22-4e09-8fa5-a674f6000576" returned: 0 in 1.047s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-108841cf-31be-404a-8ee8-700fc39f1cc9 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f.18adce35-de22-4e09-8fa5-a674f6000576 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:51 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f.18adce35-de22-4e09-8fa5-a674f6000576 Jul 10 18:32:51 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:52 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9778b404-7c32-4a01-be8b-57064ee65b5f tempest-ProjectReaderTests-1682954090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03" returned: 0 in 1.028s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9778b404-7c32-4a01-be8b-57064ee65b5f tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03.fe9344e7-8acf-41bb-9047-d4a1883222cc 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:52 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03.fe9344e7-8acf-41bb-9047-d4a1883222cc 1G Jul 10 18:32:52 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:52 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-108841cf-31be-404a-8ee8-700fc39f1cc9 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f.18adce35-de22-4e09-8fa5-a674f6000576" returned: 0 in 0.762s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:52 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=129,cinder:INSERT=44,cinder:UPDATE=158,cinder:DELETE=17 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:32:52 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=130,cinder:INSERT=53,cinder:UPDATE=179,cinder:DELETE=10 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:32:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-108841cf-31be-404a-8ee8-700fc39f1cc9 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-18adce35-de22-4e09-8fa5-a674f6000576" released by "_delete_snapshot" :: held 4.067s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-108841cf-31be-404a-8ee8-700fc39f1cc9 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-4d447913-6eaf-4b4f-a8c4-47ebca655e5f" released by "delete_snapshot" :: held 4.119s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:52 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-108841cf-31be-404a-8ee8-700fc39f1cc9 tempest-ProjectMemberTests-1041831846 None] Created reservations ['4cd02779-1352-4f92-9882-0009bc19e90b', '2efa9456-c647-4b73-9389-b63aae1092f0', 'e408d311-d94a-4135-9292-1809a5786c61', '3fe39e94-d07a-4195-9ffa-e38e40d64181'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:32:52 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-108841cf-31be-404a-8ee8-700fc39f1cc9 tempest-ProjectMemberTests-1041831846 None] Delete snapshot completed successfully. Jul 10 18:32:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-108841cf-31be-404a-8ee8-700fc39f1cc9 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-18adce35-de22-4e09-8fa5-a674f6000576-delete_snapshot" released by "delete_snapshot" :: held 4.298s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:52 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:32:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] Flow 'volume_create_manager' (337e371e-f390-413a-8191-0215c189ee2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:32:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1989eb4-fb1c-463b-80c8-890cdec8449e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1989eb4-fb1c-463b-80c8-890cdec8449e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1528598627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf697f64-5f5a-421d-9487-5b90a17569e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1211bfea8e84fecbbb20665bdd401a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:32:53Z,use_quota=True,user_id='f377474793304d1385799589d97ec160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e298252-f9c3-4e04-b89d-13fbce8f5f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e298252-f9c3-4e04-b89d-13fbce8f5f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54393012-cea4-401f-95b0-678cdc5899ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54393012-cea4-401f-95b0-678cdc5899ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf697f64-5f5a-421d-9487-5b90a17569e6', 'volume_name': 'volume-bf697f64-5f5a-421d-9487-5b90a17569e6', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e112a774-cc83-4a13-8d47-b150e3a038da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e112a774-cc83-4a13-8d47-b150e3a038da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (233d40a7-e3ff-401e-983d-9f96de4c6c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:52 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] Volume bf697f64-5f5a-421d-9487-5b90a17569e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf697f64-5f5a-421d-9487-5b90a17569e6', 'volume_size': 1} Jul 10 18:32:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:32:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b3c1e383-3521-41d9-a2c0-d6c2eac9b39b tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-4d447913-6eaf-4b4f-a8c4-47ebca655e5f-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b3c1e383-3521-41d9-a2c0-d6c2eac9b39b tempest-ProjectMemberTests-1041831846 None] Lock "cinder-4d447913-6eaf-4b4f-a8c4-47ebca655e5f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b3c1e383-3521-41d9-a2c0-d6c2eac9b39b tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-quobyte-4d447913-6eaf-4b4f-a8c4-47ebca655e5f" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b3c1e383-3521-41d9-a2c0-d6c2eac9b39b tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-4d447913-6eaf-4b4f-a8c4-47ebca655e5f" acquired by "delete_volume" :: waited 0.016s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:52 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e82f88-213d-445c-9fa7-bff8b346cbf2]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:32:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b3c1e383-3521-41d9-a2c0-d6c2eac9b39b tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:53 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9778b404-7c32-4a01-be8b-57064ee65b5f tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03.fe9344e7-8acf-41bb-9047-d4a1883222cc 1G" returned: 0 in 0.972s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9778b404-7c32-4a01-be8b-57064ee65b5f tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03.fe9344e7-8acf-41bb-9047-d4a1883222cc {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:53 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f Jul 10 18:32:53 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:53 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03.fe9344e7-8acf-41bb-9047-d4a1883222cc Jul 10 18:32:53 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:53 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:53 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9778b404-7c32-4a01-be8b-57064ee65b5f tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03.fe9344e7-8acf-41bb-9047-d4a1883222cc" returned: 0 in 0.724s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:53 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-9778b404-7c32-4a01-be8b-57064ee65b5f tempest-ProjectReaderTests-1682954090 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03.fe9344e7-8acf-41bb-9047-d4a1883222cc is being set with open permissions: ugo+rw Jul 10 18:32:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9778b404-7c32-4a01-be8b-57064ee65b5f tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03.fe9344e7-8acf-41bb-9047-d4a1883222cc {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b3c1e383-3521-41d9-a2c0-d6c2eac9b39b tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f" returned: 0 in 0.826s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b3c1e383-3521-41d9-a2c0-d6c2eac9b39b tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:53 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03.fe9344e7-8acf-41bb-9047-d4a1883222cc Jul 10 18:32:53 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:53 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f Jul 10 18:32:53 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:54 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9778b404-7c32-4a01-be8b-57064ee65b5f tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03.fe9344e7-8acf-41bb-9047-d4a1883222cc" returned: 0 in 0.654s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:54 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9778b404-7c32-4a01-be8b-57064ee65b5f tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b3c1e383-3521-41d9-a2c0-d6c2eac9b39b tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-4d447913-6eaf-4b4f-a8c4-47ebca655e5f" returned: 0 in 0.681s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:54 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03.info Jul 10 18:32:54 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b3c1e383-3521-41d9-a2c0-d6c2eac9b39b tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-4d447913-6eaf-4b4f-a8c4-47ebca655e5f" released by "delete_volume" :: held 1.575s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:54 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:54 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-b3c1e383-3521-41d9-a2c0-d6c2eac9b39b tempest-ProjectMemberTests-1041831846 None] Created reservations ['c2bcddb2-9039-4ec0-b1ca-233e6e9a5e51', 'c4101811-810f-4caa-81ed-16fa11fb3e4f', 'b39d0b07-ac16-49ed-bfe2-e29d931e29fa', 'a372acb3-80fe-477e-8976-c7df9eee0ce9'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:32:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b3c1e383-3521-41d9-a2c0-d6c2eac9b39b tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:32:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b3c1e383-3521-41d9-a2c0-d6c2eac9b39b tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:32:54 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b3c1e383-3521-41d9-a2c0-d6c2eac9b39b tempest-ProjectMemberTests-1041831846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:32:54 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-b3c1e383-3521-41d9-a2c0-d6c2eac9b39b tempest-ProjectMemberTests-1041831846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:32:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-b3c1e383-3521-41d9-a2c0-d6c2eac9b39b tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:32:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b3c1e383-3521-41d9-a2c0-d6c2eac9b39b tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:54 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:32:54 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:55 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9778b404-7c32-4a01-be8b-57064ee65b5f tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03.info" returned: 0 in 0.691s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:55 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-9778b404-7c32-4a01-be8b-57064ee65b5f tempest-ProjectReaderTests-1682954090 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03.info is being set with open permissions: ugo+rw Jul 10 18:32:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9778b404-7c32-4a01-be8b-57064ee65b5f tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:55 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03.info Jul 10 18:32:55 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:55 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-b3c1e383-3521-41d9-a2c0-d6c2eac9b39b tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.667s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:55 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-b3c1e383-3521-41d9-a2c0-d6c2eac9b39b tempest-ProjectMemberTests-1041831846 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:32:55 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-b3c1e383-3521-41d9-a2c0-d6c2eac9b39b tempest-ProjectMemberTests-1041831846 None] Deleted volume successfully. Jul 10 18:32:55 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-b3c1e383-3521-41d9-a2c0-d6c2eac9b39b tempest-ProjectMemberTests-1041831846 None] Lock "cinder-4d447913-6eaf-4b4f-a8c4-47ebca655e5f-delete_volume" released by "delete_volume" :: held 2.454s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:55 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:32:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] Flow 'volume_create_manager' (0ae73b13-6fe6-4ee2-85ff-9d1be6544868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:32:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f69a8bb-3677-42fe-a7b1-c7834d8a8e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f69a8bb-3677-42fe-a7b1-c7834d8a8e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-975750679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab5573a169b463e9ccae9d5c832530c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:32:55Z,use_quota=True,user_id='db9bc81f72324f5da33633fdc460fbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8e2ab8-3c1e-474b-9c11-1225c08b5d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8e2ab8-3c1e-474b-9c11-1225c08b5d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1519a1e3-2beb-4ee2-9270-23caa8b4755c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1519a1e3-2beb-4ee2-9270-23caa8b4755c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7', 'volume_name': 'volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41545dcb-6c20-49e7-a931-255ee696a10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41545dcb-6c20-49e7-a931-255ee696a10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0555b6cd-271e-4267-9d81-dbcbd7a435f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:55 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] Volume 6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7', 'volume_size': 1} Jul 10 18:32:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:32:55 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9778b404-7c32-4a01-be8b-57064ee65b5f tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03.info" returned: 0 in 0.695s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9778b404-7c32-4a01-be8b-57064ee65b5f tempest-ProjectReaderTests-1682954090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.876s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:32:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.018s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:32:55 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1528598627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf697f64-5f5a-421d-9487-5b90a17569e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1211bfea8e84fecbbb20665bdd401a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:32:53Z,use_quota=True,user_id='f377474793304d1385799589d97ec160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:32:55 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] Creating volume bf697f64-5f5a-421d-9487-5b90a17569e6 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:32:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:32:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:32:55 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:32:55 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:32:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:32:55 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:32:55 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:32:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:55 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6 1073741824 Jul 10 18:32:55 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:55 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-9778b404-7c32-4a01-be8b-57064ee65b5f tempest-ProjectReaderTests-1682954090 None] Create snapshot completed successfully Jul 10 18:32:56 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2c8ca420-97d7-44a2-9889-e6c101895ed1 tempest-ProjectReaderTests-1682954090 None] Acquiring lock "cinder-fe9344e7-8acf-41bb-9047-d4a1883222cc-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:56 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2c8ca420-97d7-44a2-9889-e6c101895ed1 tempest-ProjectReaderTests-1682954090 None] Lock "cinder-fe9344e7-8acf-41bb-9047-d4a1883222cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:56 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2c8ca420-97d7-44a2-9889-e6c101895ed1 tempest-ProjectReaderTests-1682954090 None] Acquiring lock "cinder-quobyte-b5e5bb7c-9ccb-46e7-9974-4756206cdf03" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:56 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2c8ca420-97d7-44a2-9889-e6c101895ed1 tempest-ProjectReaderTests-1682954090 None] Lock "cinder-quobyte-b5e5bb7c-9ccb-46e7-9974-4756206cdf03" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:56 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2c8ca420-97d7-44a2-9889-e6c101895ed1 tempest-ProjectReaderTests-1682954090 None] Acquiring lock "cinder-quobyte-fe9344e7-8acf-41bb-9047-d4a1883222cc" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:32:56 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2c8ca420-97d7-44a2-9889-e6c101895ed1 tempest-ProjectReaderTests-1682954090 None] Lock "cinder-quobyte-fe9344e7-8acf-41bb-9047-d4a1883222cc" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:32:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-2c8ca420-97d7-44a2-9889-e6c101895ed1 tempest-ProjectReaderTests-1682954090 None] Deleting offline snapshot fe9344e7-8acf-41bb-9047-d4a1883222cc of volume b5e5bb7c-9ccb-46e7-9974-4756206cdf03 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:32:56 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-2c8ca420-97d7-44a2-9889-e6c101895ed1 tempest-ProjectReaderTests-1682954090 None] snapshot_file for this snap is: volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03.fe9344e7-8acf-41bb-9047-d4a1883222cc {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:32:56 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[884a52ad-dcb3-434e-b5b0-865615898575]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:32:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2c8ca420-97d7-44a2-9889-e6c101895ed1 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03.fe9344e7-8acf-41bb-9047-d4a1883222cc {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:56 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03.fe9344e7-8acf-41bb-9047-d4a1883222cc Jul 10 18:32:56 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:56 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6 1073741824" returned: 0 in 0.869s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:56 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6 Jul 10 18:32:56 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:57 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2c8ca420-97d7-44a2-9889-e6c101895ed1 tempest-ProjectReaderTests-1682954090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03.fe9344e7-8acf-41bb-9047-d4a1883222cc" returned: 0 in 0.796s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-2c8ca420-97d7-44a2-9889-e6c101895ed1 tempest-ProjectReaderTests-1682954090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:32:57 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f2b370-6439-4519-a73c-1eaea6534414]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:32:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2c8ca420-97d7-44a2-9889-e6c101895ed1 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:57 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03 Jul 10 18:32:57 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:57 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6" returned: 0 in 0.660s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:32:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:32:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.849s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:32:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-975750679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab5573a169b463e9ccae9d5c832530c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:32:55Z,use_quota=True,user_id='db9bc81f72324f5da33633fdc460fbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:32:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] Creating volume 6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:32:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:32:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:32:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:32:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:32:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:32:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:32:57 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:32:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:57 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (233d40a7-e3ff-401e-983d-9f96de4c6c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf697f64-5f5a-421d-9487-5b90a17569e6', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:57 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7 1073741824 Jul 10 18:32:57 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa47a154-64be-471b-8b78-14b216908170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:57 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:57 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] Volume volume-bf697f64-5f5a-421d-9487-5b90a17569e6 (bf697f64-5f5a-421d-9487-5b90a17569e6): created successfully Jul 10 18:32:57 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa47a154-64be-471b-8b78-14b216908170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:57 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] Flow 'volume_create_manager' (337e371e-f390-413a-8191-0215c189ee2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:32:57 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:32:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:32:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:32:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:32:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:32:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:32:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:57 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-384b6279-7efa-4743-9af1-97e343b81745 tempest-SnapshotDependencyTests-669122545 None] Created volume successfully. Jul 10 18:32:57 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:32:57 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:57 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2c8ca420-97d7-44a2-9889-e6c101895ed1 tempest-ProjectReaderTests-1682954090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03" returned: 0 in 0.820s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2c8ca420-97d7-44a2-9889-e6c101895ed1 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03.fe9344e7-8acf-41bb-9047-d4a1883222cc {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:57 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03.fe9344e7-8acf-41bb-9047-d4a1883222cc Jul 10 18:32:57 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:58 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.719s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:58 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:32:58 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager._thread_info {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:32:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread count: 28 {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 18:32:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread info: [<_MainThread(MainThread, started 139757428633728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 18:32:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-70f1f50c-d1b6-48e8-96d9-516bf244fd24 tempest-SnapshotDependencyTests-669122545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:32:58 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7 1073741824" returned: 0 in 0.930s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:58 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7 Jul 10 18:32:58 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:58 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2c8ca420-97d7-44a2-9889-e6c101895ed1 tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03.fe9344e7-8acf-41bb-9047-d4a1883222cc" returned: 0 in 0.857s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2c8ca420-97d7-44a2-9889-e6c101895ed1 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03.fe9344e7-8acf-41bb-9047-d4a1883222cc {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:58 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03.fe9344e7-8acf-41bb-9047-d4a1883222cc Jul 10 18:32:58 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:59 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7" returned: 0 in 0.686s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:59 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:32:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:32:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-70f1f50c-d1b6-48e8-96d9-516bf244fd24 tempest-SnapshotDependencyTests-669122545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.821s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:32:59 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-70f1f50c-d1b6-48e8-96d9-516bf244fd24 tempest-SnapshotDependencyTests-669122545 None] Creating offline snapshot 80b37df9-6a33-4e6c-9020-10112fc6c6b5 of volume bf697f64-5f5a-421d-9487-5b90a17569e6 {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:32:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0555b6cd-271e-4267-9d81-dbcbd7a435f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab6f6f3-e383-4017-ace7-bfbd118af0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:32:59 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f6ef99-b828-451f-883e-bd3f1b78147d]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:32:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-70f1f50c-d1b6-48e8-96d9-516bf244fd24 tempest-SnapshotDependencyTests-669122545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:32:59 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] Volume volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7 (6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7): created successfully Jul 10 18:32:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bab6f6f3-e383-4017-ace7-bfbd118af0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:32:59 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] Flow 'volume_create_manager' (0ae73b13-6fe6-4ee2-85ff-9d1be6544868) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:32:59 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-7b69a614-80ce-41b9-a5e6-15ff7c16c046 tempest-ProjectMemberTests-1041831846 None] Created volume successfully. Jul 10 18:32:59 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6 Jul 10 18:32:59 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:32:59 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Jul 10 18:32:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2c8ca420-97d7-44a2-9889-e6c101895ed1 tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03.fe9344e7-8acf-41bb-9047-d4a1883222cc" returned: 0 in 0.681s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:32:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2c8ca420-97d7-44a2-9889-e6c101895ed1 tempest-ProjectReaderTests-1682954090 None] Lock "cinder-quobyte-fe9344e7-8acf-41bb-9047-d4a1883222cc" released by "_delete_snapshot" :: held 3.241s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2c8ca420-97d7-44a2-9889-e6c101895ed1 tempest-ProjectReaderTests-1682954090 None] Lock "cinder-quobyte-b5e5bb7c-9ccb-46e7-9974-4756206cdf03" released by "delete_snapshot" :: held 3.263s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:59 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-2c8ca420-97d7-44a2-9889-e6c101895ed1 tempest-ProjectReaderTests-1682954090 None] Created reservations ['0a382037-cc66-48eb-80cd-6c321f52676e', 'eb558f02-e94d-4f3e-9fff-f680f22083f9', 'a7ac7e45-3b69-49ab-bb97-2414a6f35924', 'e9490f0a-790c-49c5-b3f4-3297b767bf55'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:32:59 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-2c8ca420-97d7-44a2-9889-e6c101895ed1 tempest-ProjectReaderTests-1682954090 None] Delete snapshot completed successfully. Jul 10 18:32:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2c8ca420-97d7-44a2-9889-e6c101895ed1 tempest-ProjectReaderTests-1682954090 None] Lock "cinder-fe9344e7-8acf-41bb-9047-d4a1883222cc-delete_snapshot" released by "delete_snapshot" :: held 3.400s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:32:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2fa67243-1796-456f-8f01-55a6a34db72a tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:33:00 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-70f1f50c-d1b6-48e8-96d9-516bf244fd24 tempest-SnapshotDependencyTests-669122545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6" returned: 0 in 0.843s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-70f1f50c-d1b6-48e8-96d9-516bf244fd24 tempest-SnapshotDependencyTests-669122545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6.80b37df9-6a33-4e6c-9020-10112fc6c6b5 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:00 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6.80b37df9-6a33-4e6c-9020-10112fc6c6b5 1G Jul 10 18:33:00 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:00 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-93fb3502-3b0d-491b-92ba-f3397c98435d tempest-ProjectReaderTests-1682954090 None] Acquiring lock "cinder-b5e5bb7c-9ccb-46e7-9974-4756206cdf03-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:00 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-93fb3502-3b0d-491b-92ba-f3397c98435d tempest-ProjectReaderTests-1682954090 None] Lock "cinder-b5e5bb7c-9ccb-46e7-9974-4756206cdf03-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:00 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-93fb3502-3b0d-491b-92ba-f3397c98435d tempest-ProjectReaderTests-1682954090 None] Acquiring lock "cinder-quobyte-b5e5bb7c-9ccb-46e7-9974-4756206cdf03" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:00 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-93fb3502-3b0d-491b-92ba-f3397c98435d tempest-ProjectReaderTests-1682954090 None] Lock "cinder-quobyte-b5e5bb7c-9ccb-46e7-9974-4756206cdf03" acquired by "delete_volume" :: waited 0.024s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:00 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc8747b-b03e-44d2-88d6-d677cc61948e]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:33:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-93fb3502-3b0d-491b-92ba-f3397c98435d tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:00 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03 Jul 10 18:33:00 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:00 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-70f1f50c-d1b6-48e8-96d9-516bf244fd24 tempest-SnapshotDependencyTests-669122545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6.80b37df9-6a33-4e6c-9020-10112fc6c6b5 1G" returned: 0 in 0.798s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-70f1f50c-d1b6-48e8-96d9-516bf244fd24 tempest-SnapshotDependencyTests-669122545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf697f64-5f5a-421d-9487-5b90a17569e6 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6.80b37df9-6a33-4e6c-9020-10112fc6c6b5 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:00 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf697f64-5f5a-421d-9487-5b90a17569e6 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6.80b37df9-6a33-4e6c-9020-10112fc6c6b5 Jul 10 18:33:00 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:01 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-93fb3502-3b0d-491b-92ba-f3397c98435d tempest-ProjectReaderTests-1682954090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03" returned: 0 in 0.783s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-93fb3502-3b0d-491b-92ba-f3397c98435d tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:01 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03 Jul 10 18:33:01 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:01 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-70f1f50c-d1b6-48e8-96d9-516bf244fd24 tempest-SnapshotDependencyTests-669122545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf697f64-5f5a-421d-9487-5b90a17569e6 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6.80b37df9-6a33-4e6c-9020-10112fc6c6b5" returned: 0 in 0.715s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:01 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-70f1f50c-d1b6-48e8-96d9-516bf244fd24 tempest-SnapshotDependencyTests-669122545 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6.80b37df9-6a33-4e6c-9020-10112fc6c6b5 is being set with open permissions: ugo+rw Jul 10 18:33:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-70f1f50c-d1b6-48e8-96d9-516bf244fd24 tempest-SnapshotDependencyTests-669122545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6.80b37df9-6a33-4e6c-9020-10112fc6c6b5 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:01 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6.80b37df9-6a33-4e6c-9020-10112fc6c6b5 Jul 10 18:33:01 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:02 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-93fb3502-3b0d-491b-92ba-f3397c98435d tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-b5e5bb7c-9ccb-46e7-9974-4756206cdf03" returned: 0 in 0.717s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-93fb3502-3b0d-491b-92ba-f3397c98435d tempest-ProjectReaderTests-1682954090 None] Lock "cinder-quobyte-b5e5bb7c-9ccb-46e7-9974-4756206cdf03" released by "delete_volume" :: held 1.562s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:02 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-93fb3502-3b0d-491b-92ba-f3397c98435d tempest-ProjectReaderTests-1682954090 None] Created reservations ['eb472a41-3cd9-402c-b85e-6d7cdeb6a29e', 'fe553ac9-2ea4-4e6e-a7d4-35aa8256f002', 'b99b5e8f-9cc7-49c0-b016-c2adff6f8fee', '081e1d7c-40db-4e8f-89a5-1c84fff57441'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:33:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-93fb3502-3b0d-491b-92ba-f3397c98435d tempest-ProjectReaderTests-1682954090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:33:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-93fb3502-3b0d-491b-92ba-f3397c98435d tempest-ProjectReaderTests-1682954090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:33:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-93fb3502-3b0d-491b-92ba-f3397c98435d tempest-ProjectReaderTests-1682954090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:33:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-93fb3502-3b0d-491b-92ba-f3397c98435d tempest-ProjectReaderTests-1682954090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:33:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-93fb3502-3b0d-491b-92ba-f3397c98435d tempest-ProjectReaderTests-1682954090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:33:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-93fb3502-3b0d-491b-92ba-f3397c98435d tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:02 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-70f1f50c-d1b6-48e8-96d9-516bf244fd24 tempest-SnapshotDependencyTests-669122545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6.80b37df9-6a33-4e6c-9020-10112fc6c6b5" returned: 0 in 0.708s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:02 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:33:02 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-70f1f50c-d1b6-48e8-96d9-516bf244fd24 tempest-SnapshotDependencyTests-669122545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:02 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6.info Jul 10 18:33:02 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:02 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:02 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-93fb3502-3b0d-491b-92ba-f3397c98435d tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.707s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:02 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-93fb3502-3b0d-491b-92ba-f3397c98435d tempest-ProjectReaderTests-1682954090 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:33:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-70f1f50c-d1b6-48e8-96d9-516bf244fd24 tempest-SnapshotDependencyTests-669122545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6.info" returned: 0 in 0.671s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:02 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-70f1f50c-d1b6-48e8-96d9-516bf244fd24 tempest-SnapshotDependencyTests-669122545 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6.info is being set with open permissions: ugo+rw Jul 10 18:33:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-70f1f50c-d1b6-48e8-96d9-516bf244fd24 tempest-SnapshotDependencyTests-669122545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:02 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-93fb3502-3b0d-491b-92ba-f3397c98435d tempest-ProjectReaderTests-1682954090 None] Deleted volume successfully. Jul 10 18:33:02 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6.info Jul 10 18:33:02 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-93fb3502-3b0d-491b-92ba-f3397c98435d tempest-ProjectReaderTests-1682954090 None] Lock "cinder-b5e5bb7c-9ccb-46e7-9974-4756206cdf03-delete_volume" released by "delete_volume" :: held 2.511s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:03 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:33:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] Flow 'volume_create_manager' (c91b2f77-c11d-4396-bde8-f3af628e44bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:33:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (576df9d9-23b2-4fbd-8d7c-1fa7285bcdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (576df9d9-23b2-4fbd-8d7c-1fa7285bcdbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1504851888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=920f70f7-d4b2-47a9-b4dc-2c995556cd8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='935a1657e6614ac3a2269f04e097247e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:33:03Z,use_quota=True,user_id='bf797658fda948239bec7f0bcb759bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2102b30-d282-4146-b6b4-e2390de93106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2102b30-d282-4146-b6b4-e2390de93106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9b9871a-b7d4-47db-b129-b16591262c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9b9871a-b7d4-47db-b129-b16591262c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '920f70f7-d4b2-47a9-b4dc-2c995556cd8e', 'volume_name': 'volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92948dac-4749-42c4-94f8-706786dfe2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92948dac-4749-42c4-94f8-706786dfe2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:03 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fcabc8f-1b32-466b-9fab-70550ddb937b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:03 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] Volume 920f70f7-d4b2-47a9-b4dc-2c995556cd8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e', 'volume_size': 1} Jul 10 18:33:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:33:03 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-70f1f50c-d1b6-48e8-96d9-516bf244fd24 tempest-SnapshotDependencyTests-669122545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6.info" returned: 0 in 0.677s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-70f1f50c-d1b6-48e8-96d9-516bf244fd24 tempest-SnapshotDependencyTests-669122545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.507s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:33:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2fa67243-1796-456f-8f01-55a6a34db72a tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.714s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:33:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-2fa67243-1796-456f-8f01-55a6a34db72a tempest-ProjectMemberTests-1041831846 None] Creating offline snapshot da173bea-ff0c-4e73-ac66-d1634b31c195 of volume 6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7 {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:33:03 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-70f1f50c-d1b6-48e8-96d9-516bf244fd24 tempest-SnapshotDependencyTests-669122545 None] Create snapshot completed successfully Jul 10 18:33:03 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1c538a-dfeb-4f6a-9f94-f56bed4c6e19]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:33:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2fa67243-1796-456f-8f01-55a6a34db72a tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:03 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7 Jul 10 18:33:03 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:04 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2fa67243-1796-456f-8f01-55a6a34db72a tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7" returned: 0 in 0.757s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2fa67243-1796-456f-8f01-55a6a34db72a tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7.da173bea-ff0c-4e73-ac66-d1634b31c195 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:04 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7.da173bea-ff0c-4e73-ac66-d1634b31c195 1G Jul 10 18:33:04 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:05 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:33:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Flow 'volume_create_manager' (b792d3da-7a8a-40c5-a3ed-b51c1e4850f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:33:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0369051a-6570-4169-bb46-24ac0d0e5682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0369051a-6570-4169-bb46-24ac0d0e5682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fedfecb7-326f-48c0-8bd9-873cea328243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1211bfea8e84fecbbb20665bdd401a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=80b37df9-6a33-4e6c-9020-10112fc6c6b5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:33:05Z,use_quota=True,user_id='f377474793304d1385799589d97ec160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05f318e1-748c-4558-97be-d3e939790147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05f318e1-748c-4558-97be-d3e939790147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4974184b-ed97-4a56-b787-925d808e356d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4974184b-ed97-4a56-b787-925d808e356d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fedfecb7-326f-48c0-8bd9-873cea328243', 'volume_name': 'volume-fedfecb7-326f-48c0-8bd9-873cea328243', 'volume_size': 1, 'snapshot_id': '80b37df9-6a33-4e6c-9020-10112fc6c6b5'}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30779dec-8b6b-4804-aa7a-f692adc6d29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30779dec-8b6b-4804-aa7a-f692adc6d29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (768e375d-eaff-4385-86e7-68003bac6f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:05 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Volume fedfecb7-326f-48c0-8bd9-873cea328243: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fedfecb7-326f-48c0-8bd9-873cea328243', 'volume_size': 1, 'snapshot_id': '80b37df9-6a33-4e6c-9020-10112fc6c6b5'} Jul 10 18:33:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:33:05 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2fa67243-1796-456f-8f01-55a6a34db72a tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7.da173bea-ff0c-4e73-ac66-d1634b31c195 1G" returned: 0 in 0.890s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2fa67243-1796-456f-8f01-55a6a34db72a tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7.da173bea-ff0c-4e73-ac66-d1634b31c195 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:05 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7.da173bea-ff0c-4e73-ac66-d1634b31c195 Jul 10 18:33:05 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:06 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2fa67243-1796-456f-8f01-55a6a34db72a tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7.da173bea-ff0c-4e73-ac66-d1634b31c195" returned: 0 in 0.689s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:06 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-2fa67243-1796-456f-8f01-55a6a34db72a tempest-ProjectMemberTests-1041831846 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7.da173bea-ff0c-4e73-ac66-d1634b31c195 is being set with open permissions: ugo+rw Jul 10 18:33:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2fa67243-1796-456f-8f01-55a6a34db72a tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7.da173bea-ff0c-4e73-ac66-d1634b31c195 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:06 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7.da173bea-ff0c-4e73-ac66-d1634b31c195 Jul 10 18:33:06 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:06 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2fa67243-1796-456f-8f01-55a6a34db72a tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7.da173bea-ff0c-4e73-ac66-d1634b31c195" returned: 0 in 0.649s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2fa67243-1796-456f-8f01-55a6a34db72a tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:06 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7.info Jul 10 18:33:06 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:07 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2fa67243-1796-456f-8f01-55a6a34db72a tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7.info" returned: 0 in 0.654s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:07 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-2fa67243-1796-456f-8f01-55a6a34db72a tempest-ProjectMemberTests-1041831846 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7.info is being set with open permissions: ugo+rw Jul 10 18:33:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2fa67243-1796-456f-8f01-55a6a34db72a tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:07 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7.info Jul 10 18:33:07 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:07 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2fa67243-1796-456f-8f01-55a6a34db72a tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7.info" returned: 0 in 0.646s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-2fa67243-1796-456f-8f01-55a6a34db72a tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.373s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:33:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.749s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:33:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1504851888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=920f70f7-d4b2-47a9-b4dc-2c995556cd8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='935a1657e6614ac3a2269f04e097247e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:33:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:33:03Z,use_quota=True,user_id='bf797658fda948239bec7f0bcb759bf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:33:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] Creating volume 920f70f7-d4b2-47a9-b4dc-2c995556cd8e {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:33:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:33:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:33:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:33:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:33:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:33:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:33:08 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:33:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:08 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e 1073741824 Jul 10 18:33:08 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:08 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-2fa67243-1796-456f-8f01-55a6a34db72a tempest-ProjectMemberTests-1041831846 None] Create snapshot completed successfully Jul 10 18:33:08 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ceabae91-cd35-4368-9190-1a3745c8beba tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-da173bea-ff0c-4e73-ac66-d1634b31c195-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:08 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ceabae91-cd35-4368-9190-1a3745c8beba tempest-ProjectMemberTests-1041831846 None] Lock "cinder-da173bea-ff0c-4e73-ac66-d1634b31c195-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:08 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ceabae91-cd35-4368-9190-1a3745c8beba tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-quobyte-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:08 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ceabae91-cd35-4368-9190-1a3745c8beba tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:08 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ceabae91-cd35-4368-9190-1a3745c8beba tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-quobyte-da173bea-ff0c-4e73-ac66-d1634b31c195" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:08 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ceabae91-cd35-4368-9190-1a3745c8beba tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-da173bea-ff0c-4e73-ac66-d1634b31c195" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-ceabae91-cd35-4368-9190-1a3745c8beba tempest-ProjectMemberTests-1041831846 None] Deleting offline snapshot da173bea-ff0c-4e73-ac66-d1634b31c195 of volume 6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:33:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-ceabae91-cd35-4368-9190-1a3745c8beba tempest-ProjectMemberTests-1041831846 None] snapshot_file for this snap is: volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7.da173bea-ff0c-4e73-ac66-d1634b31c195 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:33:08 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cb150a-b167-4366-93cc-9082efa5d12a]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:33:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ceabae91-cd35-4368-9190-1a3745c8beba tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7.da173bea-ff0c-4e73-ac66-d1634b31c195 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:08 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7.da173bea-ff0c-4e73-ac66-d1634b31c195 Jul 10 18:33:08 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:08 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e 1073741824" returned: 0 in 0.820s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:08 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e Jul 10 18:33:08 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:09 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ceabae91-cd35-4368-9190-1a3745c8beba tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7.da173bea-ff0c-4e73-ac66-d1634b31c195" returned: 0 in 0.782s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-ceabae91-cd35-4368-9190-1a3745c8beba tempest-ProjectMemberTests-1041831846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:33:09 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e435e3b-057d-495c-b8e7-0ca3386de92b]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:33:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ceabae91-cd35-4368-9190-1a3745c8beba tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:09 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7 Jul 10 18:33:09 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:09 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e" returned: 0 in 0.628s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:33:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:33:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.325s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:33:09 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Acquiring lock "cinder-quobyte-80b37df9-6a33-4e6c-9020-10112fc6c6b5-fedfecb7-326f-48c0-8bd9-873cea328243" by "_create_volume_from_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:09 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fcabc8f-1b32-466b-9fab-70550ddb937b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:09 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (801fa22f-9af1-4995-a9f6-e49a4a81e640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:09 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Lock "cinder-quobyte-80b37df9-6a33-4e6c-9020-10112fc6c6b5-fedfecb7-326f-48c0-8bd9-873cea328243" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Creating volume fedfecb7-326f-48c0-8bd9-873cea328243 from snapshot 80b37df9-6a33-4e6c-9020-10112fc6c6b5 {{(pid=87399) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 18:33:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:33:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:33:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:33:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:33:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:33:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:33:09 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Acquiring lock "cinder-quobyte-fedfecb7-326f-48c0-8bd9-873cea328243" by "_copy_volume_from_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:09 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] Volume volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e (920f70f7-d4b2-47a9-b4dc-2c995556cd8e): created successfully Jul 10 18:33:09 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (801fa22f-9af1-4995-a9f6-e49a4a81e640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:09 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] Flow 'volume_create_manager' (c91b2f77-c11d-4396-bde8-f3af628e44bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:33:09 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Lock "cinder-quobyte-fedfecb7-326f-48c0-8bd9-873cea328243" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] snapshot: 80b37df9-6a33-4e6c-9020-10112fc6c6b5, volume: fedfecb7-326f-48c0-8bd9-873cea328243, {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 18:33:09 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-95b82544-d304-4e2b-bc07-20dcd3c50e1e tempest-ProjectReaderTests-1682954090 None] Created volume successfully. Jul 10 18:33:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:33:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:33:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:33:09 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:33:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:33:09 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f58ca4f-3e82-4f93-a284-6c10041a8725]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:33:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6.80b37df9-6a33-4e6c-9020-10112fc6c6b5 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:09 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6.80b37df9-6a33-4e6c-9020-10112fc6c6b5 Jul 10 18:33:09 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:09 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ceabae91-cd35-4368-9190-1a3745c8beba tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7" returned: 0 in 0.766s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ceabae91-cd35-4368-9190-1a3745c8beba tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7.da173bea-ff0c-4e73-ac66-d1634b31c195 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:09 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7.da173bea-ff0c-4e73-ac66-d1634b31c195 Jul 10 18:33:09 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:10 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6.80b37df9-6a33-4e6c-9020-10112fc6c6b5" returned: 0 in 0.759s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:10 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf697f64-5f5a-421d-9487-5b90a17569e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:33:10 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] will copy from snapshot at /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6 {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 18:33:10 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Creating direct copy from snapshot {{(pid=87399) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 18:33:10 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[135d45a7-5965-4656-b831-640ea4799c54]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:33:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:10 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6 Jul 10 18:33:10 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-bf5b621c-90f1-404d-9e56-eb75fa3b0814 tempest-ProjectReaderTests-1682954090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:33:10 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ceabae91-cd35-4368-9190-1a3745c8beba tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7.da173bea-ff0c-4e73-ac66-d1634b31c195" returned: 0 in 0.815s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ceabae91-cd35-4368-9190-1a3745c8beba tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7.da173bea-ff0c-4e73-ac66-d1634b31c195 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:10 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7.da173bea-ff0c-4e73-ac66-d1634b31c195 Jul 10 18:33:10 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:11 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6" returned: 0 in 0.819s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:11 devstack cinder-volume[87399]: DEBUG cinder.utils [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Path /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fedfecb7-326f-48c0-8bd9-873cea328243 not found in is_blk_device check {{(pid=87399) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 18:33:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fedfecb7-326f-48c0-8bd9-873cea328243 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:11 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fedfecb7-326f-48c0-8bd9-873cea328243 Jul 10 18:33:11 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:11 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ceabae91-cd35-4368-9190-1a3745c8beba tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7.da173bea-ff0c-4e73-ac66-d1634b31c195" returned: 0 in 0.707s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:11 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ceabae91-cd35-4368-9190-1a3745c8beba tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-da173bea-ff0c-4e73-ac66-d1634b31c195" released by "_delete_snapshot" :: held 3.195s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:11 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ceabae91-cd35-4368-9190-1a3745c8beba tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7" released by "delete_snapshot" :: held 3.221s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:11 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-ceabae91-cd35-4368-9190-1a3745c8beba tempest-ProjectMemberTests-1041831846 None] Created reservations ['72d7dc47-c3f6-4755-94b8-9cd279769a25', '2fdcffde-aee5-4574-bab3-a4c540e77bf0', '3b54d8e6-8785-4ea6-b015-5163d8583c9d', 'f164106d-259b-4c75-b1f2-6710205d51dd'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:33:11 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-ceabae91-cd35-4368-9190-1a3745c8beba tempest-ProjectMemberTests-1041831846 None] Delete snapshot completed successfully. Jul 10 18:33:11 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ceabae91-cd35-4368-9190-1a3745c8beba tempest-ProjectMemberTests-1041831846 None] Lock "cinder-da173bea-ff0c-4e73-ac66-d1634b31c195-delete_snapshot" released by "delete_snapshot" :: held 3.425s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5fe04237-b37c-4dbb-9b54-503e5c3e04e8 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5fe04237-b37c-4dbb-9b54-503e5c3e04e8 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5fe04237-b37c-4dbb-9b54-503e5c3e04e8 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-quobyte-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5fe04237-b37c-4dbb-9b54-503e5c3e04e8 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7" acquired by "delete_volume" :: waited 0.040s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:12 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff53e35-50d8-4055-b9d8-2ff6382712bd]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:33:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5fe04237-b37c-4dbb-9b54-503e5c3e04e8 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:13 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7 Jul 10 18:33:13 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:14 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5fe04237-b37c-4dbb-9b54-503e5c3e04e8 tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7" returned: 0 in 1.545s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5fe04237-b37c-4dbb-9b54-503e5c3e04e8 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:14 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7 Jul 10 18:33:14 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:16 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5fe04237-b37c-4dbb-9b54-503e5c3e04e8 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7" returned: 0 in 1.531s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:16 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5fe04237-b37c-4dbb-9b54-503e5c3e04e8 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7" released by "delete_volume" :: held 3.212s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:16 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-5fe04237-b37c-4dbb-9b54-503e5c3e04e8 tempest-ProjectMemberTests-1041831846 None] Created reservations ['853f1b43-3c2a-44da-bf7b-7c560506a970', '2c6c1214-bbfc-4433-8153-689643393a64', '16b3e8e0-024a-4f5a-b96d-4cf8b21d5699', '0958f63a-8a32-4a21-ad71-68dac0d4e849'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:33:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5fe04237-b37c-4dbb-9b54-503e5c3e04e8 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:33:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5fe04237-b37c-4dbb-9b54-503e5c3e04e8 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:33:16 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5fe04237-b37c-4dbb-9b54-503e5c3e04e8 tempest-ProjectMemberTests-1041831846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:33:16 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5fe04237-b37c-4dbb-9b54-503e5c3e04e8 tempest-ProjectMemberTests-1041831846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:33:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5fe04237-b37c-4dbb-9b54-503e5c3e04e8 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:33:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5fe04237-b37c-4dbb-9b54-503e5c3e04e8 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:16 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fedfecb7-326f-48c0-8bd9-873cea328243" returned: 0 in 5.044s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:16 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:33:16 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:16 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3d5a7c-8f0d-4f03-aa19-c30e418a0f0b]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:33:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:16 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6 Jul 10 18:33:16 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:16 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:33:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] Flow 'volume_create_manager' (09124c47-012b-4610-9376-b1ebcf34b55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:33:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cd64ca9-e993-4cfe-9404-c1322ad50245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cd64ca9-e993-4cfe-9404-c1322ad50245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1916979508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d38d7a-d9e4-41a3-b604-2af44d229f55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab5573a169b463e9ccae9d5c832530c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:33:17Z,use_quota=True,user_id='db9bc81f72324f5da33633fdc460fbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (876e6a95-acb0-48d9-a82b-60ee8befea1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (876e6a95-acb0-48d9-a82b-60ee8befea1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a727397b-334a-42b7-859e-55ff161b8c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a727397b-334a-42b7-859e-55ff161b8c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2d38d7a-d9e4-41a3-b604-2af44d229f55', 'volume_name': 'volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64efce72-a14b-467d-898f-e65583899901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64efce72-a14b-467d-898f-e65583899901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:16 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1140bd-d497-43ec-a142-ebb4f42c151b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:16 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] Volume d2d38d7a-d9e4-41a3-b604-2af44d229f55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55', 'volume_size': 1} Jul 10 18:33:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:33:16 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5fe04237-b37c-4dbb-9b54-503e5c3e04e8 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.663s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:16 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-5fe04237-b37c-4dbb-9b54-503e5c3e04e8 tempest-ProjectMemberTests-1041831846 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:33:16 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-5fe04237-b37c-4dbb-9b54-503e5c3e04e8 tempest-ProjectMemberTests-1041831846 None] Deleted volume successfully. Jul 10 18:33:16 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5fe04237-b37c-4dbb-9b54-503e5c3e04e8 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-6db0d045-2337-4fc8-ab4e-76fcb8e6bbc7-delete_volume" released by "delete_volume" :: held 4.215s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:17 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6" returned: 0 in 0.947s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:17 devstack cinder-volume[87399]: DEBUG cinder.image.image_utils [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Image conversion details: src /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6, size 1024.00 MB, duration 5.05 sec, destination /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fedfecb7-326f-48c0-8bd9-873cea328243 {{(pid=87399) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 10 18:33:17 devstack cinder-volume[87399]: INFO cinder.image.image_utils [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Converted 1024.00 MB image at 202.97 MB/s Jul 10 18:33:17 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fedfecb7-326f-48c0-8bd9-873cea328243 is being set with open permissions: ugo+rw Jul 10 18:33:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fedfecb7-326f-48c0-8bd9-873cea328243 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:17 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fedfecb7-326f-48c0-8bd9-873cea328243 Jul 10 18:33:17 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:17 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fedfecb7-326f-48c0-8bd9-873cea328243" returned: 0 in 0.640s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:17 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Lock "cinder-quobyte-fedfecb7-326f-48c0-8bd9-873cea328243" released by "_copy_volume_from_snapshot" :: held 8.308s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:17 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Lock "cinder-quobyte-80b37df9-6a33-4e6c-9020-10112fc6c6b5-fedfecb7-326f-48c0-8bd9-873cea328243" released by "_create_volume_from_snapshot" :: held 8.359s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.394s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:33:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-bf5b621c-90f1-404d-9e56-eb75fa3b0814 tempest-ProjectReaderTests-1682954090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.154s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:33:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-bf5b621c-90f1-404d-9e56-eb75fa3b0814 tempest-ProjectReaderTests-1682954090 None] Creating offline snapshot 3d83daca-bc5c-4fa9-809c-e878b4eab734 of volume 920f70f7-d4b2-47a9-b4dc-2c995556cd8e {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:33:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (768e375d-eaff-4385-86e7-68003bac6f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fedfecb7-326f-48c0-8bd9-873cea328243', 'volume_size': 1, 'snapshot_id': '80b37df9-6a33-4e6c-9020-10112fc6c6b5'}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7c3db65-1c9f-46e5-a30a-5936143c3d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:17 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b787b0-563d-46a5-bf5e-00a84cd82dec]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:33:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bf5b621c-90f1-404d-9e56-eb75fa3b0814 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:17 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Volume volume-fedfecb7-326f-48c0-8bd9-873cea328243 (fedfecb7-326f-48c0-8bd9-873cea328243): created successfully Jul 10 18:33:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7c3db65-1c9f-46e5-a30a-5936143c3d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Flow 'volume_create_manager' (b792d3da-7a8a-40c5-a3ed-b51c1e4850f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:33:18 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-8c491bef-540f-4422-a163-50186755c150 tempest-SnapshotDependencyTests-669122545 None] Created volume successfully. Jul 10 18:33:18 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e Jul 10 18:33:18 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:18 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1d8c1fe9-6d13-4d91-b479-a88516bf0433 tempest-SnapshotDependencyTests-669122545 None] Acquiring lock "cinder-80b37df9-6a33-4e6c-9020-10112fc6c6b5-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:18 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1d8c1fe9-6d13-4d91-b479-a88516bf0433 tempest-SnapshotDependencyTests-669122545 None] Lock "cinder-80b37df9-6a33-4e6c-9020-10112fc6c6b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:18 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1d8c1fe9-6d13-4d91-b479-a88516bf0433 tempest-SnapshotDependencyTests-669122545 None] Acquiring lock "cinder-quobyte-bf697f64-5f5a-421d-9487-5b90a17569e6" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:18 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1d8c1fe9-6d13-4d91-b479-a88516bf0433 tempest-SnapshotDependencyTests-669122545 None] Lock "cinder-quobyte-bf697f64-5f5a-421d-9487-5b90a17569e6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:18 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1d8c1fe9-6d13-4d91-b479-a88516bf0433 tempest-SnapshotDependencyTests-669122545 None] Acquiring lock "cinder-quobyte-80b37df9-6a33-4e6c-9020-10112fc6c6b5" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:18 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1d8c1fe9-6d13-4d91-b479-a88516bf0433 tempest-SnapshotDependencyTests-669122545 None] Lock "cinder-quobyte-80b37df9-6a33-4e6c-9020-10112fc6c6b5" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:18 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-1d8c1fe9-6d13-4d91-b479-a88516bf0433 tempest-SnapshotDependencyTests-669122545 None] Deleting offline snapshot 80b37df9-6a33-4e6c-9020-10112fc6c6b5 of volume bf697f64-5f5a-421d-9487-5b90a17569e6 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:33:18 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-1d8c1fe9-6d13-4d91-b479-a88516bf0433 tempest-SnapshotDependencyTests-669122545 None] snapshot_file for this snap is: volume-bf697f64-5f5a-421d-9487-5b90a17569e6.80b37df9-6a33-4e6c-9020-10112fc6c6b5 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:33:18 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[5251d45c-cd8c-4890-9466-853719c3fad1]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:33:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1d8c1fe9-6d13-4d91-b479-a88516bf0433 tempest-SnapshotDependencyTests-669122545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6.80b37df9-6a33-4e6c-9020-10112fc6c6b5 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:18 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6.80b37df9-6a33-4e6c-9020-10112fc6c6b5 Jul 10 18:33:18 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:18 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bf5b621c-90f1-404d-9e56-eb75fa3b0814 tempest-ProjectReaderTests-1682954090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e" returned: 0 in 0.801s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bf5b621c-90f1-404d-9e56-eb75fa3b0814 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e.3d83daca-bc5c-4fa9-809c-e878b4eab734 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:18 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e.3d83daca-bc5c-4fa9-809c-e878b4eab734 1G Jul 10 18:33:18 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:19 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1d8c1fe9-6d13-4d91-b479-a88516bf0433 tempest-SnapshotDependencyTests-669122545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6.80b37df9-6a33-4e6c-9020-10112fc6c6b5" returned: 0 in 0.754s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:19 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-1d8c1fe9-6d13-4d91-b479-a88516bf0433 tempest-SnapshotDependencyTests-669122545 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf697f64-5f5a-421d-9487-5b90a17569e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:33:19 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b2a10d-72d0-409c-9554-e66d02affda8]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:33:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1d8c1fe9-6d13-4d91-b479-a88516bf0433 tempest-SnapshotDependencyTests-669122545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:19 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6 Jul 10 18:33:19 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:19 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bf5b621c-90f1-404d-9e56-eb75fa3b0814 tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e.3d83daca-bc5c-4fa9-809c-e878b4eab734 1G" returned: 0 in 0.826s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bf5b621c-90f1-404d-9e56-eb75fa3b0814 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e.3d83daca-bc5c-4fa9-809c-e878b4eab734 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:19 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e.3d83daca-bc5c-4fa9-809c-e878b4eab734 Jul 10 18:33:19 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:19 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1d8c1fe9-6d13-4d91-b479-a88516bf0433 tempest-SnapshotDependencyTests-669122545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6" returned: 0 in 0.784s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1d8c1fe9-6d13-4d91-b479-a88516bf0433 tempest-SnapshotDependencyTests-669122545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6.80b37df9-6a33-4e6c-9020-10112fc6c6b5 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:19 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6.80b37df9-6a33-4e6c-9020-10112fc6c6b5 Jul 10 18:33:19 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:20 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bf5b621c-90f1-404d-9e56-eb75fa3b0814 tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e.3d83daca-bc5c-4fa9-809c-e878b4eab734" returned: 0 in 0.705s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:20 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-bf5b621c-90f1-404d-9e56-eb75fa3b0814 tempest-ProjectReaderTests-1682954090 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e.3d83daca-bc5c-4fa9-809c-e878b4eab734 is being set with open permissions: ugo+rw Jul 10 18:33:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bf5b621c-90f1-404d-9e56-eb75fa3b0814 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e.3d83daca-bc5c-4fa9-809c-e878b4eab734 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:20 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e.3d83daca-bc5c-4fa9-809c-e878b4eab734 Jul 10 18:33:20 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:20 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1d8c1fe9-6d13-4d91-b479-a88516bf0433 tempest-SnapshotDependencyTests-669122545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6.80b37df9-6a33-4e6c-9020-10112fc6c6b5" returned: 0 in 0.732s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1d8c1fe9-6d13-4d91-b479-a88516bf0433 tempest-SnapshotDependencyTests-669122545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6.80b37df9-6a33-4e6c-9020-10112fc6c6b5 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:20 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6.80b37df9-6a33-4e6c-9020-10112fc6c6b5 Jul 10 18:33:20 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:20 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bf5b621c-90f1-404d-9e56-eb75fa3b0814 tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e.3d83daca-bc5c-4fa9-809c-e878b4eab734" returned: 0 in 0.681s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bf5b621c-90f1-404d-9e56-eb75fa3b0814 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:21 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e.info Jul 10 18:33:21 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:21 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1d8c1fe9-6d13-4d91-b479-a88516bf0433 tempest-SnapshotDependencyTests-669122545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6.80b37df9-6a33-4e6c-9020-10112fc6c6b5" returned: 0 in 0.642s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:21 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1d8c1fe9-6d13-4d91-b479-a88516bf0433 tempest-SnapshotDependencyTests-669122545 None] Lock "cinder-quobyte-80b37df9-6a33-4e6c-9020-10112fc6c6b5" released by "_delete_snapshot" :: held 3.026s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:21 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1d8c1fe9-6d13-4d91-b479-a88516bf0433 tempest-SnapshotDependencyTests-669122545 None] Lock "cinder-quobyte-bf697f64-5f5a-421d-9487-5b90a17569e6" released by "delete_snapshot" :: held 3.055s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:21 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-1d8c1fe9-6d13-4d91-b479-a88516bf0433 tempest-SnapshotDependencyTests-669122545 None] Created reservations ['0113dc6a-441f-4089-990c-980c5d0de4bc', '9bbb07ff-f035-481e-afbb-a9830ebedae6', '4c0661c9-f78a-4dd2-b9f5-7ebcdff6e98c', '7468b3a5-a833-4d3f-9b1e-d948fa2d62ac'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:33:21 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-1d8c1fe9-6d13-4d91-b479-a88516bf0433 tempest-SnapshotDependencyTests-669122545 None] Delete snapshot completed successfully. Jul 10 18:33:21 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1d8c1fe9-6d13-4d91-b479-a88516bf0433 tempest-SnapshotDependencyTests-669122545 None] Lock "cinder-80b37df9-6a33-4e6c-9020-10112fc6c6b5-delete_snapshot" released by "delete_snapshot" :: held 3.189s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:21 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bf5b621c-90f1-404d-9e56-eb75fa3b0814 tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e.info" returned: 0 in 0.697s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:21 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-bf5b621c-90f1-404d-9e56-eb75fa3b0814 tempest-ProjectReaderTests-1682954090 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e.info is being set with open permissions: ugo+rw Jul 10 18:33:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bf5b621c-90f1-404d-9e56-eb75fa3b0814 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:21 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e.info Jul 10 18:33:21 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:22 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bf5b621c-90f1-404d-9e56-eb75fa3b0814 tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e.info" returned: 0 in 0.628s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-bf5b621c-90f1-404d-9e56-eb75fa3b0814 tempest-ProjectReaderTests-1682954090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.441s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:33:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.486s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:33:22 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1916979508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d38d7a-d9e4-41a3-b604-2af44d229f55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab5573a169b463e9ccae9d5c832530c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:33:17Z,use_quota=True,user_id='db9bc81f72324f5da33633fdc460fbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:33:22 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] Creating volume d2d38d7a-d9e4-41a3-b604-2af44d229f55 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:33:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:33:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:33:22 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:33:22 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:33:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:33:22 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:33:22 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:33:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:22 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55 1073741824 Jul 10 18:33:22 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:22 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4d40e4dc-ede5-4baa-8634-80bfc05e7b8c tempest-SnapshotDependencyTests-669122545 None] Acquiring lock "cinder-bf697f64-5f5a-421d-9487-5b90a17569e6-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:22 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-bf5b621c-90f1-404d-9e56-eb75fa3b0814 tempest-ProjectReaderTests-1682954090 None] Create snapshot completed successfully Jul 10 18:33:22 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4d40e4dc-ede5-4baa-8634-80bfc05e7b8c tempest-SnapshotDependencyTests-669122545 None] Lock "cinder-bf697f64-5f5a-421d-9487-5b90a17569e6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:22 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4d40e4dc-ede5-4baa-8634-80bfc05e7b8c tempest-SnapshotDependencyTests-669122545 None] Acquiring lock "cinder-quobyte-bf697f64-5f5a-421d-9487-5b90a17569e6" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:22 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4d40e4dc-ede5-4baa-8634-80bfc05e7b8c tempest-SnapshotDependencyTests-669122545 None] Lock "cinder-quobyte-bf697f64-5f5a-421d-9487-5b90a17569e6" acquired by "delete_volume" :: waited 0.016s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:22 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3fb1bd-8d7f-4ac3-b17b-36b82721cf2c]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:33:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4d40e4dc-ede5-4baa-8634-80bfc05e7b8c tempest-SnapshotDependencyTests-669122545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:22 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6 Jul 10 18:33:22 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:23 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55 1073741824" returned: 0 in 0.809s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:23 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55 Jul 10 18:33:23 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:23 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4d40e4dc-ede5-4baa-8634-80bfc05e7b8c tempest-SnapshotDependencyTests-669122545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6" returned: 0 in 0.828s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4d40e4dc-ede5-4baa-8634-80bfc05e7b8c tempest-SnapshotDependencyTests-669122545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:23 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6 Jul 10 18:33:23 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:23 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4c250507-5149-48fb-bd0c-300e18c0568c tempest-ProjectReaderTests-1682954090 None] Acquiring lock "cinder-3d83daca-bc5c-4fa9-809c-e878b4eab734-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:23 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4c250507-5149-48fb-bd0c-300e18c0568c tempest-ProjectReaderTests-1682954090 None] Lock "cinder-3d83daca-bc5c-4fa9-809c-e878b4eab734-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:23 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4c250507-5149-48fb-bd0c-300e18c0568c tempest-ProjectReaderTests-1682954090 None] Acquiring lock "cinder-quobyte-920f70f7-d4b2-47a9-b4dc-2c995556cd8e" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:23 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4c250507-5149-48fb-bd0c-300e18c0568c tempest-ProjectReaderTests-1682954090 None] Lock "cinder-quobyte-920f70f7-d4b2-47a9-b4dc-2c995556cd8e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:23 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4c250507-5149-48fb-bd0c-300e18c0568c tempest-ProjectReaderTests-1682954090 None] Acquiring lock "cinder-quobyte-3d83daca-bc5c-4fa9-809c-e878b4eab734" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:23 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4c250507-5149-48fb-bd0c-300e18c0568c tempest-ProjectReaderTests-1682954090 None] Lock "cinder-quobyte-3d83daca-bc5c-4fa9-809c-e878b4eab734" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:23 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-4c250507-5149-48fb-bd0c-300e18c0568c tempest-ProjectReaderTests-1682954090 None] Deleting offline snapshot 3d83daca-bc5c-4fa9-809c-e878b4eab734 of volume 920f70f7-d4b2-47a9-b4dc-2c995556cd8e {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:33:23 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-4c250507-5149-48fb-bd0c-300e18c0568c tempest-ProjectReaderTests-1682954090 None] snapshot_file for this snap is: volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e.3d83daca-bc5c-4fa9-809c-e878b4eab734 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:33:23 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe497104-1063-43c5-a98a-70bb5c3d8529]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:33:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4c250507-5149-48fb-bd0c-300e18c0568c tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e.3d83daca-bc5c-4fa9-809c-e878b4eab734 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:23 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e.3d83daca-bc5c-4fa9-809c-e878b4eab734 Jul 10 18:33:23 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:23 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55" returned: 0 in 0.671s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:23 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:33:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:33:23 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1140bd-d497-43ec-a142-ebb4f42c151b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:23 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ca9c8d-9f18-4240-91a1-21dace5afc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:23 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] Volume volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55 (d2d38d7a-d9e4-41a3-b604-2af44d229f55): created successfully Jul 10 18:33:23 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83ca9c8d-9f18-4240-91a1-21dace5afc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:23 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] Flow 'volume_create_manager' (09124c47-012b-4610-9376-b1ebcf34b55b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:33:23 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-1f81b1ed-ff21-4be8-a67e-ce98e73ccbbe tempest-ProjectMemberTests-1041831846 None] Created volume successfully. Jul 10 18:33:24 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4d40e4dc-ede5-4baa-8634-80bfc05e7b8c tempest-SnapshotDependencyTests-669122545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-bf697f64-5f5a-421d-9487-5b90a17569e6" returned: 0 in 0.722s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:24 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4d40e4dc-ede5-4baa-8634-80bfc05e7b8c tempest-SnapshotDependencyTests-669122545 None] Lock "cinder-quobyte-bf697f64-5f5a-421d-9487-5b90a17569e6" released by "delete_volume" :: held 1.620s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:24 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-4d40e4dc-ede5-4baa-8634-80bfc05e7b8c tempest-SnapshotDependencyTests-669122545 None] Created reservations ['6eef4d49-bcd9-418f-bae6-bcd5066ea73e', '3e2c28d1-3f5e-4bb7-af2d-86333588c83b', 'ad8255d4-9688-403e-bbca-1e089f867801', '2ead19bd-a5f6-488a-a88a-6bfc86e7f5ac'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:33:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4d40e4dc-ede5-4baa-8634-80bfc05e7b8c tempest-SnapshotDependencyTests-669122545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:33:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4d40e4dc-ede5-4baa-8634-80bfc05e7b8c tempest-SnapshotDependencyTests-669122545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:33:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-4d40e4dc-ede5-4baa-8634-80bfc05e7b8c tempest-SnapshotDependencyTests-669122545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:33:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-4d40e4dc-ede5-4baa-8634-80bfc05e7b8c tempest-SnapshotDependencyTests-669122545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:33:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-4d40e4dc-ede5-4baa-8634-80bfc05e7b8c tempest-SnapshotDependencyTests-669122545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:33:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4d40e4dc-ede5-4baa-8634-80bfc05e7b8c tempest-SnapshotDependencyTests-669122545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:24 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:33:24 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-bc9817a8-6d52-4f1f-a8da-e8a0fa21c140 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:33:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-bc9817a8-6d52-4f1f-a8da-e8a0fa21c140 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:33:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-bc9817a8-6d52-4f1f-a8da-e8a0fa21c140 tempest-ProjectMemberTests-1041831846 None] Creating offline snapshot d133482c-1d88-4a79-a692-ab656efc5cbb of volume d2d38d7a-d9e4-41a3-b604-2af44d229f55 {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:33:24 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[09001278-21c9-4f08-9221-66b350ba2ad0]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:33:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bc9817a8-6d52-4f1f-a8da-e8a0fa21c140 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:24 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4c250507-5149-48fb-bd0c-300e18c0568c tempest-ProjectReaderTests-1682954090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e.3d83daca-bc5c-4fa9-809c-e878b4eab734" returned: 0 in 0.844s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:24 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-4c250507-5149-48fb-bd0c-300e18c0568c tempest-ProjectReaderTests-1682954090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:33:24 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[658ef4a8-48b6-4b68-a56c-97d57efe70da]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:33:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4c250507-5149-48fb-bd0c-300e18c0568c tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:24 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55 Jul 10 18:33:24 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:24 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e Jul 10 18:33:24 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:24 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f229cb05-01b4-464c-be6e-475d1ab431ce tempest-SnapshotDependencyTests-669122545 None] Acquiring lock "cinder-fedfecb7-326f-48c0-8bd9-873cea328243-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:24 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f229cb05-01b4-464c-be6e-475d1ab431ce tempest-SnapshotDependencyTests-669122545 None] Lock "cinder-fedfecb7-326f-48c0-8bd9-873cea328243-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:24 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f229cb05-01b4-464c-be6e-475d1ab431ce tempest-SnapshotDependencyTests-669122545 None] Acquiring lock "cinder-quobyte-fedfecb7-326f-48c0-8bd9-873cea328243" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:24 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f229cb05-01b4-464c-be6e-475d1ab431ce tempest-SnapshotDependencyTests-669122545 None] Lock "cinder-quobyte-fedfecb7-326f-48c0-8bd9-873cea328243" acquired by "delete_volume" :: waited 0.024s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:24 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[d629edaf-b4d8-4965-ab1d-38b2192ddb06]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:33:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f229cb05-01b4-464c-be6e-475d1ab431ce tempest-SnapshotDependencyTests-669122545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fedfecb7-326f-48c0-8bd9-873cea328243 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:24 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4d40e4dc-ede5-4baa-8634-80bfc05e7b8c tempest-SnapshotDependencyTests-669122545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.717s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:24 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-4d40e4dc-ede5-4baa-8634-80bfc05e7b8c tempest-SnapshotDependencyTests-669122545 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:33:24 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-4d40e4dc-ede5-4baa-8634-80bfc05e7b8c tempest-SnapshotDependencyTests-669122545 None] Deleted volume successfully. Jul 10 18:33:24 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fedfecb7-326f-48c0-8bd9-873cea328243 Jul 10 18:33:24 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:24 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4d40e4dc-ede5-4baa-8634-80bfc05e7b8c tempest-SnapshotDependencyTests-669122545 None] Lock "cinder-bf697f64-5f5a-421d-9487-5b90a17569e6-delete_volume" released by "delete_volume" :: held 2.541s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:25 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4c250507-5149-48fb-bd0c-300e18c0568c tempest-ProjectReaderTests-1682954090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e" returned: 0 in 0.826s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4c250507-5149-48fb-bd0c-300e18c0568c tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e.3d83daca-bc5c-4fa9-809c-e878b4eab734 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:25 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bc9817a8-6d52-4f1f-a8da-e8a0fa21c140 tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55" returned: 0 in 0.916s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bc9817a8-6d52-4f1f-a8da-e8a0fa21c140 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55.d133482c-1d88-4a79-a692-ab656efc5cbb 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:25 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e.3d83daca-bc5c-4fa9-809c-e878b4eab734 Jul 10 18:33:25 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:25 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55.d133482c-1d88-4a79-a692-ab656efc5cbb 1G Jul 10 18:33:25 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:25 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f229cb05-01b4-464c-be6e-475d1ab431ce tempest-SnapshotDependencyTests-669122545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fedfecb7-326f-48c0-8bd9-873cea328243" returned: 0 in 0.833s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f229cb05-01b4-464c-be6e-475d1ab431ce tempest-SnapshotDependencyTests-669122545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fedfecb7-326f-48c0-8bd9-873cea328243 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:25 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fedfecb7-326f-48c0-8bd9-873cea328243 Jul 10 18:33:25 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:26 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4c250507-5149-48fb-bd0c-300e18c0568c tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e.3d83daca-bc5c-4fa9-809c-e878b4eab734" returned: 0 in 0.801s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4c250507-5149-48fb-bd0c-300e18c0568c tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e.3d83daca-bc5c-4fa9-809c-e878b4eab734 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:26 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e.3d83daca-bc5c-4fa9-809c-e878b4eab734 Jul 10 18:33:26 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:26 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bc9817a8-6d52-4f1f-a8da-e8a0fa21c140 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55.d133482c-1d88-4a79-a692-ab656efc5cbb 1G" returned: 0 in 0.881s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bc9817a8-6d52-4f1f-a8da-e8a0fa21c140 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55.d133482c-1d88-4a79-a692-ab656efc5cbb {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:26 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55.d133482c-1d88-4a79-a692-ab656efc5cbb Jul 10 18:33:26 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:26 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f229cb05-01b4-464c-be6e-475d1ab431ce tempest-SnapshotDependencyTests-669122545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fedfecb7-326f-48c0-8bd9-873cea328243" returned: 0 in 0.711s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:26 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f229cb05-01b4-464c-be6e-475d1ab431ce tempest-SnapshotDependencyTests-669122545 None] Lock "cinder-quobyte-fedfecb7-326f-48c0-8bd9-873cea328243" released by "delete_volume" :: held 1.602s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:26 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-f229cb05-01b4-464c-be6e-475d1ab431ce tempest-SnapshotDependencyTests-669122545 None] Created reservations ['6d552187-72ad-4014-87e6-8a237a3f5ec0', '5f8800c9-beda-40ce-819b-3dc239b9ab22', '01791a35-b26e-422d-9890-870e149253d9', 'f6a174af-cb63-49ac-97fd-a7257dbf9f93'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:33:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f229cb05-01b4-464c-be6e-475d1ab431ce tempest-SnapshotDependencyTests-669122545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:33:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f229cb05-01b4-464c-be6e-475d1ab431ce tempest-SnapshotDependencyTests-669122545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:33:26 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f229cb05-01b4-464c-be6e-475d1ab431ce tempest-SnapshotDependencyTests-669122545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:33:26 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-f229cb05-01b4-464c-be6e-475d1ab431ce tempest-SnapshotDependencyTests-669122545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:33:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-f229cb05-01b4-464c-be6e-475d1ab431ce tempest-SnapshotDependencyTests-669122545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:33:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f229cb05-01b4-464c-be6e-475d1ab431ce tempest-SnapshotDependencyTests-669122545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:26 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:33:26 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:26 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-4c250507-5149-48fb-bd0c-300e18c0568c tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e.3d83daca-bc5c-4fa9-809c-e878b4eab734" returned: 0 in 0.722s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:26 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4c250507-5149-48fb-bd0c-300e18c0568c tempest-ProjectReaderTests-1682954090 None] Lock "cinder-quobyte-3d83daca-bc5c-4fa9-809c-e878b4eab734" released by "_delete_snapshot" :: held 3.309s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:26 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4c250507-5149-48fb-bd0c-300e18c0568c tempest-ProjectReaderTests-1682954090 None] Lock "cinder-quobyte-920f70f7-d4b2-47a9-b4dc-2c995556cd8e" released by "delete_snapshot" :: held 3.336s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:26 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-4c250507-5149-48fb-bd0c-300e18c0568c tempest-ProjectReaderTests-1682954090 None] Created reservations ['4874918e-fac6-41b1-bae8-762b748c9aa5', '08573ca2-b12b-41fe-85dc-d122579fdbd5', 'f11996e8-c677-42f8-8bd6-f5a8b68825fe', '15d8504b-7ddf-4ef0-8655-c11f1a8cbaa8'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:33:26 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bc9817a8-6d52-4f1f-a8da-e8a0fa21c140 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55.d133482c-1d88-4a79-a692-ab656efc5cbb" returned: 0 in 0.752s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:26 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-bc9817a8-6d52-4f1f-a8da-e8a0fa21c140 tempest-ProjectMemberTests-1041831846 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55.d133482c-1d88-4a79-a692-ab656efc5cbb is being set with open permissions: ugo+rw Jul 10 18:33:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bc9817a8-6d52-4f1f-a8da-e8a0fa21c140 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55.d133482c-1d88-4a79-a692-ab656efc5cbb {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:26 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55.d133482c-1d88-4a79-a692-ab656efc5cbb Jul 10 18:33:26 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:27 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-4c250507-5149-48fb-bd0c-300e18c0568c tempest-ProjectReaderTests-1682954090 None] Delete snapshot completed successfully. Jul 10 18:33:27 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-4c250507-5149-48fb-bd0c-300e18c0568c tempest-ProjectReaderTests-1682954090 None] Lock "cinder-3d83daca-bc5c-4fa9-809c-e878b4eab734-delete_snapshot" released by "delete_snapshot" :: held 3.547s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:27 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-f229cb05-01b4-464c-be6e-475d1ab431ce tempest-SnapshotDependencyTests-669122545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.733s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:27 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-f229cb05-01b4-464c-be6e-475d1ab431ce tempest-SnapshotDependencyTests-669122545 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:33:27 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-f229cb05-01b4-464c-be6e-475d1ab431ce tempest-SnapshotDependencyTests-669122545 None] Deleted volume successfully. Jul 10 18:33:27 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-f229cb05-01b4-464c-be6e-475d1ab431ce tempest-SnapshotDependencyTests-669122545 None] Lock "cinder-fedfecb7-326f-48c0-8bd9-873cea328243-delete_volume" released by "delete_volume" :: held 2.574s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:27 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bc9817a8-6d52-4f1f-a8da-e8a0fa21c140 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55.d133482c-1d88-4a79-a692-ab656efc5cbb" returned: 0 in 0.720s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bc9817a8-6d52-4f1f-a8da-e8a0fa21c140 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:27 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e3b111d9-93a1-4a36-9556-a8b31f01c1a1 tempest-ProjectReaderTests-1682954090 None] Acquiring lock "cinder-920f70f7-d4b2-47a9-b4dc-2c995556cd8e-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:27 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55.info Jul 10 18:33:27 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:27 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e3b111d9-93a1-4a36-9556-a8b31f01c1a1 tempest-ProjectReaderTests-1682954090 None] Lock "cinder-920f70f7-d4b2-47a9-b4dc-2c995556cd8e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:27 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e3b111d9-93a1-4a36-9556-a8b31f01c1a1 tempest-ProjectReaderTests-1682954090 None] Acquiring lock "cinder-quobyte-920f70f7-d4b2-47a9-b4dc-2c995556cd8e" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:27 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e3b111d9-93a1-4a36-9556-a8b31f01c1a1 tempest-ProjectReaderTests-1682954090 None] Lock "cinder-quobyte-920f70f7-d4b2-47a9-b4dc-2c995556cd8e" acquired by "delete_volume" :: waited 0.017s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:27 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[a385061a-4628-48cc-82ce-3cd120dbc67f]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:33:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e3b111d9-93a1-4a36-9556-a8b31f01c1a1 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:27 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e Jul 10 18:33:27 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:28 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bc9817a8-6d52-4f1f-a8da-e8a0fa21c140 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55.info" returned: 0 in 0.768s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:28 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-bc9817a8-6d52-4f1f-a8da-e8a0fa21c140 tempest-ProjectMemberTests-1041831846 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55.info is being set with open permissions: ugo+rw Jul 10 18:33:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bc9817a8-6d52-4f1f-a8da-e8a0fa21c140 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:28 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55.info Jul 10 18:33:28 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:28 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e3b111d9-93a1-4a36-9556-a8b31f01c1a1 tempest-ProjectReaderTests-1682954090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e" returned: 0 in 0.833s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e3b111d9-93a1-4a36-9556-a8b31f01c1a1 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:28 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e Jul 10 18:33:28 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:29 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bc9817a8-6d52-4f1f-a8da-e8a0fa21c140 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55.info" returned: 0 in 0.712s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-bc9817a8-6d52-4f1f-a8da-e8a0fa21c140 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.861s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:33:29 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-bc9817a8-6d52-4f1f-a8da-e8a0fa21c140 tempest-ProjectMemberTests-1041831846 None] Create snapshot completed successfully Jul 10 18:33:29 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e3b111d9-93a1-4a36-9556-a8b31f01c1a1 tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-920f70f7-d4b2-47a9-b4dc-2c995556cd8e" returned: 0 in 0.718s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e3b111d9-93a1-4a36-9556-a8b31f01c1a1 tempest-ProjectReaderTests-1682954090 None] Lock "cinder-quobyte-920f70f7-d4b2-47a9-b4dc-2c995556cd8e" released by "delete_volume" :: held 1.624s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:29 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-e3b111d9-93a1-4a36-9556-a8b31f01c1a1 tempest-ProjectReaderTests-1682954090 None] Created reservations ['671227fd-f2f6-4060-974a-01f0251c84b8', '3c9a6d07-975b-4697-8146-6e37752dc8ba', 'd19f2ca7-fb21-4a19-a202-268f604eec85', '42b6fa26-266f-433e-bead-851f046ea660'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:33:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e3b111d9-93a1-4a36-9556-a8b31f01c1a1 tempest-ProjectReaderTests-1682954090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:33:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e3b111d9-93a1-4a36-9556-a8b31f01c1a1 tempest-ProjectReaderTests-1682954090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:33:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e3b111d9-93a1-4a36-9556-a8b31f01c1a1 tempest-ProjectReaderTests-1682954090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:33:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e3b111d9-93a1-4a36-9556-a8b31f01c1a1 tempest-ProjectReaderTests-1682954090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:33:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e3b111d9-93a1-4a36-9556-a8b31f01c1a1 tempest-ProjectReaderTests-1682954090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:33:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e3b111d9-93a1-4a36-9556-a8b31f01c1a1 tempest-ProjectReaderTests-1682954090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:29 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:33:29 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c0c39e37-da28-4bcc-b6b4-020ac7177efc tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-d133482c-1d88-4a79-a692-ab656efc5cbb-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c0c39e37-da28-4bcc-b6b4-020ac7177efc tempest-ProjectMemberTests-1041831846 None] Lock "cinder-d133482c-1d88-4a79-a692-ab656efc5cbb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.066s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c0c39e37-da28-4bcc-b6b4-020ac7177efc tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-quobyte-d2d38d7a-d9e4-41a3-b604-2af44d229f55" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c0c39e37-da28-4bcc-b6b4-020ac7177efc tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-d2d38d7a-d9e4-41a3-b604-2af44d229f55" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c0c39e37-da28-4bcc-b6b4-020ac7177efc tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-quobyte-d133482c-1d88-4a79-a692-ab656efc5cbb" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c0c39e37-da28-4bcc-b6b4-020ac7177efc tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-d133482c-1d88-4a79-a692-ab656efc5cbb" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-c0c39e37-da28-4bcc-b6b4-020ac7177efc tempest-ProjectMemberTests-1041831846 None] Deleting offline snapshot d133482c-1d88-4a79-a692-ab656efc5cbb of volume d2d38d7a-d9e4-41a3-b604-2af44d229f55 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:33:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-c0c39e37-da28-4bcc-b6b4-020ac7177efc tempest-ProjectMemberTests-1041831846 None] snapshot_file for this snap is: volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55.d133482c-1d88-4a79-a692-ab656efc5cbb {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:33:29 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2abc4a4-4e42-4d00-b0b3-0f96ea579fbd]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:33:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c0c39e37-da28-4bcc-b6b4-020ac7177efc tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55.d133482c-1d88-4a79-a692-ab656efc5cbb {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:30 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55.d133482c-1d88-4a79-a692-ab656efc5cbb Jul 10 18:33:30 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:30 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e3b111d9-93a1-4a36-9556-a8b31f01c1a1 tempest-ProjectReaderTests-1682954090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.831s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:30 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-e3b111d9-93a1-4a36-9556-a8b31f01c1a1 tempest-ProjectReaderTests-1682954090 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:33:30 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-e3b111d9-93a1-4a36-9556-a8b31f01c1a1 tempest-ProjectReaderTests-1682954090 None] Deleted volume successfully. Jul 10 18:33:30 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e3b111d9-93a1-4a36-9556-a8b31f01c1a1 tempest-ProjectReaderTests-1682954090 None] Lock "cinder-920f70f7-d4b2-47a9-b4dc-2c995556cd8e-delete_volume" released by "delete_volume" :: held 2.712s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:30 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c0c39e37-da28-4bcc-b6b4-020ac7177efc tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55.d133482c-1d88-4a79-a692-ab656efc5cbb" returned: 0 in 0.995s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:30 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-c0c39e37-da28-4bcc-b6b4-020ac7177efc tempest-ProjectMemberTests-1041831846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:33:30 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f15ec15-4507-42f6-b7e7-936d02dfdd9e]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:33:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c0c39e37-da28-4bcc-b6b4-020ac7177efc tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:30 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55 Jul 10 18:33:30 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:31 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c0c39e37-da28-4bcc-b6b4-020ac7177efc tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55" returned: 0 in 0.896s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c0c39e37-da28-4bcc-b6b4-020ac7177efc tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55.d133482c-1d88-4a79-a692-ab656efc5cbb {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:31 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55.d133482c-1d88-4a79-a692-ab656efc5cbb Jul 10 18:33:31 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:32 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c0c39e37-da28-4bcc-b6b4-020ac7177efc tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55.d133482c-1d88-4a79-a692-ab656efc5cbb" returned: 0 in 0.837s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c0c39e37-da28-4bcc-b6b4-020ac7177efc tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55.d133482c-1d88-4a79-a692-ab656efc5cbb {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:32 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55.d133482c-1d88-4a79-a692-ab656efc5cbb Jul 10 18:33:32 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:33 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c0c39e37-da28-4bcc-b6b4-020ac7177efc tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55.d133482c-1d88-4a79-a692-ab656efc5cbb" returned: 0 in 0.715s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:33 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c0c39e37-da28-4bcc-b6b4-020ac7177efc tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-d133482c-1d88-4a79-a692-ab656efc5cbb" released by "_delete_snapshot" :: held 3.567s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:33 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c0c39e37-da28-4bcc-b6b4-020ac7177efc tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-d2d38d7a-d9e4-41a3-b604-2af44d229f55" released by "delete_snapshot" :: held 3.597s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:33 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-c0c39e37-da28-4bcc-b6b4-020ac7177efc tempest-ProjectMemberTests-1041831846 None] Created reservations ['d7765e3b-b014-481c-aa76-83220555ce50', '4eb0cf3b-61a6-4e19-b02f-1378fb50bdcd', 'f97cc7b9-ec87-4957-ae6d-ed86ce90b7f6', '9a3ab37c-d5d1-4fa4-bfef-5424a0eb7375'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:33:33 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-c0c39e37-da28-4bcc-b6b4-020ac7177efc tempest-ProjectMemberTests-1041831846 None] Delete snapshot completed successfully. Jul 10 18:33:33 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c0c39e37-da28-4bcc-b6b4-020ac7177efc tempest-ProjectMemberTests-1041831846 None] Lock "cinder-d133482c-1d88-4a79-a692-ab656efc5cbb-delete_snapshot" released by "delete_snapshot" :: held 3.769s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:33 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-fff0202e-c79e-40b3-9ebb-fd15828081be tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-d2d38d7a-d9e4-41a3-b604-2af44d229f55-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:33 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-fff0202e-c79e-40b3-9ebb-fd15828081be tempest-ProjectMemberTests-1041831846 None] Lock "cinder-d2d38d7a-d9e4-41a3-b604-2af44d229f55-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:34 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-fff0202e-c79e-40b3-9ebb-fd15828081be tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-quobyte-d2d38d7a-d9e4-41a3-b604-2af44d229f55" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:34 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-fff0202e-c79e-40b3-9ebb-fd15828081be tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-d2d38d7a-d9e4-41a3-b604-2af44d229f55" acquired by "delete_volume" :: waited 0.015s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:34 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[631a9539-40aa-41e7-93e2-c284363c1146]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:33:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fff0202e-c79e-40b3-9ebb-fd15828081be tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:34 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55 Jul 10 18:33:34 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:34 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fff0202e-c79e-40b3-9ebb-fd15828081be tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55" returned: 0 in 0.836s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fff0202e-c79e-40b3-9ebb-fd15828081be tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:34 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55 Jul 10 18:33:34 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:35 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fff0202e-c79e-40b3-9ebb-fd15828081be tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d2d38d7a-d9e4-41a3-b604-2af44d229f55" returned: 0 in 0.779s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:35 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-fff0202e-c79e-40b3-9ebb-fd15828081be tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-d2d38d7a-d9e4-41a3-b604-2af44d229f55" released by "delete_volume" :: held 1.697s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:35 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-fff0202e-c79e-40b3-9ebb-fd15828081be tempest-ProjectMemberTests-1041831846 None] Created reservations ['54c1fb37-d322-4dbe-95fc-1c1fc99e87ed', '5598d295-df6b-4c38-b009-180c56905a2e', 'c42ab63a-ecdc-40e2-be46-4fd5bd416a89', 'd4a88842-f457-4819-ad9c-b04a62e704ef'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:33:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-fff0202e-c79e-40b3-9ebb-fd15828081be tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:33:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-fff0202e-c79e-40b3-9ebb-fd15828081be tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:33:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-fff0202e-c79e-40b3-9ebb-fd15828081be tempest-ProjectMemberTests-1041831846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:33:35 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-fff0202e-c79e-40b3-9ebb-fd15828081be tempest-ProjectMemberTests-1041831846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:33:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-fff0202e-c79e-40b3-9ebb-fd15828081be tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:33:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fff0202e-c79e-40b3-9ebb-fd15828081be tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:35 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:33:35 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:36 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fff0202e-c79e-40b3-9ebb-fd15828081be tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.691s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:36 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-fff0202e-c79e-40b3-9ebb-fd15828081be tempest-ProjectMemberTests-1041831846 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:33:36 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-fff0202e-c79e-40b3-9ebb-fd15828081be tempest-ProjectMemberTests-1041831846 None] Deleted volume successfully. Jul 10 18:33:36 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-fff0202e-c79e-40b3-9ebb-fd15828081be tempest-ProjectMemberTests-1041831846 None] Lock "cinder-d2d38d7a-d9e4-41a3-b604-2af44d229f55-delete_volume" released by "delete_volume" :: held 2.610s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:36 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:33:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] Flow 'volume_create_manager' (e48b4943-9f9d-4026-bbb0-9e3084dc8531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:33:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b1e2bd-e6b0-4ce6-adbd-6fbef45dace0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b1e2bd-e6b0-4ce6-adbd-6fbef45dace0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-380954101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01731498-833a-4496-a182-89fb731efadb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab5573a169b463e9ccae9d5c832530c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:33:37Z,use_quota=True,user_id='db9bc81f72324f5da33633fdc460fbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3890ec-3e85-4f90-8f7f-4309e20c9016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af3890ec-3e85-4f90-8f7f-4309e20c9016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce7ade0-acb1-48ed-ae87-6af879a16967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce7ade0-acb1-48ed-ae87-6af879a16967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01731498-833a-4496-a182-89fb731efadb', 'volume_name': 'volume-01731498-833a-4496-a182-89fb731efadb', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01d91a9-307c-400f-b84b-1d2c86c4479a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01d91a9-307c-400f-b84b-1d2c86c4479a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:36 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a668ecf0-d2d6-4cf2-8d37-09e169860ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:36 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] Volume 01731498-833a-4496-a182-89fb731efadb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01731498-833a-4496-a182-89fb731efadb', 'volume_size': 1} Jul 10 18:33:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:33:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:33:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-380954101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01731498-833a-4496-a182-89fb731efadb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab5573a169b463e9ccae9d5c832530c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:33:37Z,use_quota=True,user_id='db9bc81f72324f5da33633fdc460fbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:33:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] Creating volume 01731498-833a-4496-a182-89fb731efadb {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:33:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:33:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:33:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:33:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:33:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:33:36 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:33:36 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:33:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:36 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb 1073741824 Jul 10 18:33:36 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:37 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb 1073741824" returned: 0 in 0.857s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:37 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb Jul 10 18:33:37 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:38 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb" returned: 0 in 0.658s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:33:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:33:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a668ecf0-d2d6-4cf2-8d37-09e169860ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01731498-833a-4496-a182-89fb731efadb', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a1e4a5e-71c1-4982-8462-00b99fb855ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:38 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] Volume volume-01731498-833a-4496-a182-89fb731efadb (01731498-833a-4496-a182-89fb731efadb): created successfully Jul 10 18:33:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a1e4a5e-71c1-4982-8462-00b99fb855ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:38 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] Flow 'volume_create_manager' (e48b4943-9f9d-4026-bbb0-9e3084dc8531) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:33:38 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-49e0b0db-c78c-4693-b8d3-83a69644e1a6 tempest-ProjectMemberTests-1041831846 None] Created volume successfully. Jul 10 18:33:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-805053d3-901c-4abd-92fb-ff53ecee7ece tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:33:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-805053d3-901c-4abd-92fb-ff53ecee7ece tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:33:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-805053d3-901c-4abd-92fb-ff53ecee7ece tempest-ProjectMemberTests-1041831846 None] Creating offline snapshot f9837b95-cfdd-4aaf-83a6-9eca88ec73b1 of volume 01731498-833a-4496-a182-89fb731efadb {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:33:38 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ece65c-7e9c-4143-9ddf-572eaaddf8d5]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:33:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-805053d3-901c-4abd-92fb-ff53ecee7ece tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:39 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb Jul 10 18:33:39 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:39 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-805053d3-901c-4abd-92fb-ff53ecee7ece tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb" returned: 0 in 0.816s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-805053d3-901c-4abd-92fb-ff53ecee7ece tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb.f9837b95-cfdd-4aaf-83a6-9eca88ec73b1 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:39 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb.f9837b95-cfdd-4aaf-83a6-9eca88ec73b1 1G Jul 10 18:33:39 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:40 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-805053d3-901c-4abd-92fb-ff53ecee7ece tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb.f9837b95-cfdd-4aaf-83a6-9eca88ec73b1 1G" returned: 0 in 0.835s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-805053d3-901c-4abd-92fb-ff53ecee7ece tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01731498-833a-4496-a182-89fb731efadb -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb.f9837b95-cfdd-4aaf-83a6-9eca88ec73b1 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:40 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01731498-833a-4496-a182-89fb731efadb -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb.f9837b95-cfdd-4aaf-83a6-9eca88ec73b1 Jul 10 18:33:40 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:41 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-805053d3-901c-4abd-92fb-ff53ecee7ece tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01731498-833a-4496-a182-89fb731efadb -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb.f9837b95-cfdd-4aaf-83a6-9eca88ec73b1" returned: 0 in 0.684s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:41 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-805053d3-901c-4abd-92fb-ff53ecee7ece tempest-ProjectMemberTests-1041831846 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb.f9837b95-cfdd-4aaf-83a6-9eca88ec73b1 is being set with open permissions: ugo+rw Jul 10 18:33:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-805053d3-901c-4abd-92fb-ff53ecee7ece tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb.f9837b95-cfdd-4aaf-83a6-9eca88ec73b1 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:41 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb.f9837b95-cfdd-4aaf-83a6-9eca88ec73b1 Jul 10 18:33:41 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:41 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-805053d3-901c-4abd-92fb-ff53ecee7ece tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb.f9837b95-cfdd-4aaf-83a6-9eca88ec73b1" returned: 0 in 0.641s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-805053d3-901c-4abd-92fb-ff53ecee7ece tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:42 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb.info Jul 10 18:33:42 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:42 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:33:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] Flow 'volume_create_manager' (c5a97e9a-0557-4134-8578-738890dac8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:33:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dba2a63-1ad2-43d5-86b3-20c536226153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dba2a63-1ad2-43d5-86b3-20c536226153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2004725640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d472a754-4ec1-46fd-8c8a-1c3c34b028f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a7f77cbf86b4c609f0f38372f30a071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:33:42Z,use_quota=True,user_id='7596a2ec8d83498ab4ec77a54534789f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d546518e-26f3-4077-8b1f-71a31719c4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d546518e-26f3-4077-8b1f-71a31719c4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c362cd6-65f7-4e81-9a5e-80ef6aa6c5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c362cd6-65f7-4e81-9a5e-80ef6aa6c5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd472a754-4ec1-46fd-8c8a-1c3c34b028f4', 'volume_name': 'volume-d472a754-4ec1-46fd-8c8a-1c3c34b028f4', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592f973b-31f0-489d-843b-c4fbbced3d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (592f973b-31f0-489d-843b-c4fbbced3d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:42 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df4a9832-45f8-48b1-bb7c-c3762857b673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:42 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] Volume d472a754-4ec1-46fd-8c8a-1c3c34b028f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d472a754-4ec1-46fd-8c8a-1c3c34b028f4', 'volume_size': 1} Jul 10 18:33:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:33:42 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-805053d3-901c-4abd-92fb-ff53ecee7ece tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb.info" returned: 0 in 0.644s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:42 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-805053d3-901c-4abd-92fb-ff53ecee7ece tempest-ProjectMemberTests-1041831846 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb.info is being set with open permissions: ugo+rw Jul 10 18:33:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-805053d3-901c-4abd-92fb-ff53ecee7ece tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:42 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb.info Jul 10 18:33:42 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:43 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-805053d3-901c-4abd-92fb-ff53ecee7ece tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb.info" returned: 0 in 0.637s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-805053d3-901c-4abd-92fb-ff53ecee7ece tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.342s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:33:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.739s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:33:43 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2004725640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d472a754-4ec1-46fd-8c8a-1c3c34b028f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a7f77cbf86b4c609f0f38372f30a071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:33:42Z,use_quota=True,user_id='7596a2ec8d83498ab4ec77a54534789f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:33:43 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] Creating volume d472a754-4ec1-46fd-8c8a-1c3c34b028f4 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:33:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:33:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:33:43 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:33:43 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:33:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:33:43 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:33:43 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:33:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d472a754-4ec1-46fd-8c8a-1c3c34b028f4 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:43 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d472a754-4ec1-46fd-8c8a-1c3c34b028f4 1073741824 Jul 10 18:33:43 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:43 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-805053d3-901c-4abd-92fb-ff53ecee7ece tempest-ProjectMemberTests-1041831846 None] Create snapshot completed successfully Jul 10 18:33:44 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d472a754-4ec1-46fd-8c8a-1c3c34b028f4 1073741824" returned: 0 in 0.836s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d472a754-4ec1-46fd-8c8a-1c3c34b028f4 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:44 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-fa58a1fe-fbc9-4ad6-9c0b-3f590620f050 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-f9837b95-cfdd-4aaf-83a6-9eca88ec73b1-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:44 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d472a754-4ec1-46fd-8c8a-1c3c34b028f4 Jul 10 18:33:44 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:44 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-fa58a1fe-fbc9-4ad6-9c0b-3f590620f050 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-f9837b95-cfdd-4aaf-83a6-9eca88ec73b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:44 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-fa58a1fe-fbc9-4ad6-9c0b-3f590620f050 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-quobyte-01731498-833a-4496-a182-89fb731efadb" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:44 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-fa58a1fe-fbc9-4ad6-9c0b-3f590620f050 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-01731498-833a-4496-a182-89fb731efadb" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:44 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-fa58a1fe-fbc9-4ad6-9c0b-3f590620f050 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-quobyte-f9837b95-cfdd-4aaf-83a6-9eca88ec73b1" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:44 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-fa58a1fe-fbc9-4ad6-9c0b-3f590620f050 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-f9837b95-cfdd-4aaf-83a6-9eca88ec73b1" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:44 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-fa58a1fe-fbc9-4ad6-9c0b-3f590620f050 tempest-ProjectMemberTests-1041831846 None] Deleting offline snapshot f9837b95-cfdd-4aaf-83a6-9eca88ec73b1 of volume 01731498-833a-4496-a182-89fb731efadb {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:33:44 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-fa58a1fe-fbc9-4ad6-9c0b-3f590620f050 tempest-ProjectMemberTests-1041831846 None] snapshot_file for this snap is: volume-01731498-833a-4496-a182-89fb731efadb.f9837b95-cfdd-4aaf-83a6-9eca88ec73b1 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:33:44 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5f2308-54e0-49ad-89ef-ff40a3bb9824]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:33:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fa58a1fe-fbc9-4ad6-9c0b-3f590620f050 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb.f9837b95-cfdd-4aaf-83a6-9eca88ec73b1 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:44 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb.f9837b95-cfdd-4aaf-83a6-9eca88ec73b1 Jul 10 18:33:44 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:44 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d472a754-4ec1-46fd-8c8a-1c3c34b028f4" returned: 0 in 0.687s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:44 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:33:44 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:33:44 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df4a9832-45f8-48b1-bb7c-c3762857b673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d472a754-4ec1-46fd-8c8a-1c3c34b028f4', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:44 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c09036a5-7096-4d5f-bf11-f3d88b574141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:44 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] Volume volume-d472a754-4ec1-46fd-8c8a-1c3c34b028f4 (d472a754-4ec1-46fd-8c8a-1c3c34b028f4): created successfully Jul 10 18:33:44 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c09036a5-7096-4d5f-bf11-f3d88b574141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:44 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] Flow 'volume_create_manager' (c5a97e9a-0557-4134-8578-738890dac8b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:33:44 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-daabfd7c-3332-49a5-8fb1-004ad3b5f636 tempest-ProjectReaderTests-1627580717 None] Created volume successfully. Jul 10 18:33:45 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fa58a1fe-fbc9-4ad6-9c0b-3f590620f050 tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb.f9837b95-cfdd-4aaf-83a6-9eca88ec73b1" returned: 0 in 0.767s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:45 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-fa58a1fe-fbc9-4ad6-9c0b-3f590620f050 tempest-ProjectMemberTests-1041831846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01731498-833a-4496-a182-89fb731efadb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:33:45 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[e869bf44-5ee4-4a7f-9c2a-12bd094c705a]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:33:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fa58a1fe-fbc9-4ad6-9c0b-3f590620f050 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:45 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb Jul 10 18:33:45 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:45 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-dc9df3cf-dba1-44d9-8e3e-14664fc99f23 tempest-ProjectReaderTests-1627580717 None] Acquiring lock "cinder-d472a754-4ec1-46fd-8c8a-1c3c34b028f4-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:45 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-dc9df3cf-dba1-44d9-8e3e-14664fc99f23 tempest-ProjectReaderTests-1627580717 None] Lock "cinder-d472a754-4ec1-46fd-8c8a-1c3c34b028f4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:45 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-dc9df3cf-dba1-44d9-8e3e-14664fc99f23 tempest-ProjectReaderTests-1627580717 None] Acquiring lock "cinder-quobyte-d472a754-4ec1-46fd-8c8a-1c3c34b028f4" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:45 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fa58a1fe-fbc9-4ad6-9c0b-3f590620f050 tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb" returned: 0 in 0.779s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fa58a1fe-fbc9-4ad6-9c0b-3f590620f050 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb.f9837b95-cfdd-4aaf-83a6-9eca88ec73b1 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:45 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-dc9df3cf-dba1-44d9-8e3e-14664fc99f23 tempest-ProjectReaderTests-1627580717 None] Lock "cinder-quobyte-d472a754-4ec1-46fd-8c8a-1c3c34b028f4" acquired by "delete_volume" :: waited 0.036s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:45 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb.f9837b95-cfdd-4aaf-83a6-9eca88ec73b1 Jul 10 18:33:45 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:45 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2be1d7f-02be-480f-913f-ca7ddbe7e17b]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:33:45 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-dc9df3cf-dba1-44d9-8e3e-14664fc99f23 tempest-ProjectReaderTests-1627580717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d472a754-4ec1-46fd-8c8a-1c3c34b028f4 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:45 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d472a754-4ec1-46fd-8c8a-1c3c34b028f4 Jul 10 18:33:45 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:46 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fa58a1fe-fbc9-4ad6-9c0b-3f590620f050 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb.f9837b95-cfdd-4aaf-83a6-9eca88ec73b1" returned: 0 in 0.750s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fa58a1fe-fbc9-4ad6-9c0b-3f590620f050 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb.f9837b95-cfdd-4aaf-83a6-9eca88ec73b1 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:46 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb.f9837b95-cfdd-4aaf-83a6-9eca88ec73b1 Jul 10 18:33:46 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:46 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-dc9df3cf-dba1-44d9-8e3e-14664fc99f23 tempest-ProjectReaderTests-1627580717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d472a754-4ec1-46fd-8c8a-1c3c34b028f4" returned: 0 in 0.781s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:46 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-dc9df3cf-dba1-44d9-8e3e-14664fc99f23 tempest-ProjectReaderTests-1627580717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d472a754-4ec1-46fd-8c8a-1c3c34b028f4 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:46 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d472a754-4ec1-46fd-8c8a-1c3c34b028f4 Jul 10 18:33:46 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:47 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-fa58a1fe-fbc9-4ad6-9c0b-3f590620f050 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb.f9837b95-cfdd-4aaf-83a6-9eca88ec73b1" returned: 0 in 0.687s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:47 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-dc9df3cf-dba1-44d9-8e3e-14664fc99f23 tempest-ProjectReaderTests-1627580717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-d472a754-4ec1-46fd-8c8a-1c3c34b028f4" returned: 0 in 0.646s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:47 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-fa58a1fe-fbc9-4ad6-9c0b-3f590620f050 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-f9837b95-cfdd-4aaf-83a6-9eca88ec73b1" released by "_delete_snapshot" :: held 3.086s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:47 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-fa58a1fe-fbc9-4ad6-9c0b-3f590620f050 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-01731498-833a-4496-a182-89fb731efadb" released by "delete_snapshot" :: held 3.109s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:47 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-dc9df3cf-dba1-44d9-8e3e-14664fc99f23 tempest-ProjectReaderTests-1627580717 None] Lock "cinder-quobyte-d472a754-4ec1-46fd-8c8a-1c3c34b028f4" released by "delete_volume" :: held 1.477s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:47 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-dc9df3cf-dba1-44d9-8e3e-14664fc99f23 tempest-ProjectReaderTests-1627580717 None] Created reservations ['516e7540-ef2e-4411-a2dd-f0ff2a5eb627', 'c83ce738-a1b7-45ed-ad19-ce36c27db4ab', '097b1161-3b2e-4759-b439-c373f8019eb0', 'b8e3f6af-87fb-4295-8524-66ba4edf7dcc'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:33:47 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-fa58a1fe-fbc9-4ad6-9c0b-3f590620f050 tempest-ProjectMemberTests-1041831846 None] Created reservations ['b2e2f7ba-a3bb-49eb-892d-e22d6307ff24', '10ed4b02-fe8c-4523-831f-78f1b0d9ebba', '461f3601-e004-460d-8b27-04717e77cf5c', '8733056e-8d6f-49ab-aca6-b19f6682ef00'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:33:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-dc9df3cf-dba1-44d9-8e3e-14664fc99f23 tempest-ProjectReaderTests-1627580717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:33:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-dc9df3cf-dba1-44d9-8e3e-14664fc99f23 tempest-ProjectReaderTests-1627580717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:33:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-dc9df3cf-dba1-44d9-8e3e-14664fc99f23 tempest-ProjectReaderTests-1627580717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:33:47 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-dc9df3cf-dba1-44d9-8e3e-14664fc99f23 tempest-ProjectReaderTests-1627580717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:33:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-dc9df3cf-dba1-44d9-8e3e-14664fc99f23 tempest-ProjectReaderTests-1627580717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:33:47 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-dc9df3cf-dba1-44d9-8e3e-14664fc99f23 tempest-ProjectReaderTests-1627580717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:47 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:33:47 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:47 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-fa58a1fe-fbc9-4ad6-9c0b-3f590620f050 tempest-ProjectMemberTests-1041831846 None] Delete snapshot completed successfully. Jul 10 18:33:47 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-fa58a1fe-fbc9-4ad6-9c0b-3f590620f050 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-f9837b95-cfdd-4aaf-83a6-9eca88ec73b1-delete_snapshot" released by "delete_snapshot" :: held 3.317s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:48 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-dc9df3cf-dba1-44d9-8e3e-14664fc99f23 tempest-ProjectReaderTests-1627580717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.643s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:48 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-dc9df3cf-dba1-44d9-8e3e-14664fc99f23 tempest-ProjectReaderTests-1627580717 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:33:48 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-dc9df3cf-dba1-44d9-8e3e-14664fc99f23 tempest-ProjectReaderTests-1627580717 None] Deleted volume successfully. Jul 10 18:33:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-dc9df3cf-dba1-44d9-8e3e-14664fc99f23 tempest-ProjectReaderTests-1627580717 None] Lock "cinder-d472a754-4ec1-46fd-8c8a-1c3c34b028f4-delete_volume" released by "delete_volume" :: held 2.361s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-652f4cbc-60ca-42de-af40-cfba03245cc1 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-01731498-833a-4496-a182-89fb731efadb-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-652f4cbc-60ca-42de-af40-cfba03245cc1 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-01731498-833a-4496-a182-89fb731efadb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:48 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:33:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] Flow 'volume_create_manager' (c14c179d-8409-4e17-a942-4ec7c5dfcda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:33:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe38cad2-09f6-46f0-854a-cf93b6e1c97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe38cad2-09f6-46f0-854a-cf93b6e1c97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1121860476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34a55140-cd23-418f-9868-9611648af754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a7f77cbf86b4c609f0f38372f30a071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:33:48Z,use_quota=True,user_id='7596a2ec8d83498ab4ec77a54534789f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ce0cda8-1703-4a99-8688-c868fd38de5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ce0cda8-1703-4a99-8688-c868fd38de5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4779b93-9557-4c92-8839-e4a7a001f25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4779b93-9557-4c92-8839-e4a7a001f25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34a55140-cd23-418f-9868-9611648af754', 'volume_name': 'volume-34a55140-cd23-418f-9868-9611648af754', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (255ccbea-4657-4dc2-b4f1-7a02dc5767d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (255ccbea-4657-4dc2-b4f1-7a02dc5767d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:48 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a08e1b3-a481-49ca-88d7-2fe36d7712c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:48 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] Volume 34a55140-cd23-418f-9868-9611648af754: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34a55140-cd23-418f-9868-9611648af754', 'volume_size': 1} Jul 10 18:33:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:33:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:33:48 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1121860476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34a55140-cd23-418f-9868-9611648af754,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a7f77cbf86b4c609f0f38372f30a071',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:33:48Z,use_quota=True,user_id='7596a2ec8d83498ab4ec77a54534789f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:33:48 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] Creating volume 34a55140-cd23-418f-9868-9611648af754 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:33:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:33:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:33:48 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:33:48 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:33:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:33:48 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:33:48 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:33:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-34a55140-cd23-418f-9868-9611648af754 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-652f4cbc-60ca-42de-af40-cfba03245cc1 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-quobyte-01731498-833a-4496-a182-89fb731efadb" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:48 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-34a55140-cd23-418f-9868-9611648af754 1073741824 Jul 10 18:33:48 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:48 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-652f4cbc-60ca-42de-af40-cfba03245cc1 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-01731498-833a-4496-a182-89fb731efadb" acquired by "delete_volume" :: waited 0.016s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:48 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ff380f-d7e2-4c83-809d-5b874f69d06d]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:33:48 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-652f4cbc-60ca-42de-af40-cfba03245cc1 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:48 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb Jul 10 18:33:48 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:49 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-34a55140-cd23-418f-9868-9611648af754 1073741824" returned: 0 in 0.840s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:49 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-34a55140-cd23-418f-9868-9611648af754 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-652f4cbc-60ca-42de-af40-cfba03245cc1 tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb" returned: 0 in 0.814s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:49 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-652f4cbc-60ca-42de-af40-cfba03245cc1 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:49 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-34a55140-cd23-418f-9868-9611648af754 Jul 10 18:33:49 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:49 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb Jul 10 18:33:49 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:50 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-652f4cbc-60ca-42de-af40-cfba03245cc1 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-01731498-833a-4496-a182-89fb731efadb" returned: 0 in 0.642s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:50 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-34a55140-cd23-418f-9868-9611648af754" returned: 0 in 0.671s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:50 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:33:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:33:50 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-652f4cbc-60ca-42de-af40-cfba03245cc1 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-01731498-833a-4496-a182-89fb731efadb" released by "delete_volume" :: held 1.522s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:50 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a08e1b3-a481-49ca-88d7-2fe36d7712c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34a55140-cd23-418f-9868-9611648af754', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:50 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0728409f-b55d-4f45-b65c-3b6947cbf855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:50 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] Volume volume-34a55140-cd23-418f-9868-9611648af754 (34a55140-cd23-418f-9868-9611648af754): created successfully Jul 10 18:33:50 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0728409f-b55d-4f45-b65c-3b6947cbf855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:50 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] Flow 'volume_create_manager' (c14c179d-8409-4e17-a942-4ec7c5dfcda9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:33:50 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-873c56d4-b97d-4382-88db-4cfd2721675f tempest-ProjectReaderTests-1627580717 None] Created volume successfully. Jul 10 18:33:50 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-652f4cbc-60ca-42de-af40-cfba03245cc1 tempest-ProjectMemberTests-1041831846 None] Created reservations ['27ed7e3d-9521-4104-8d88-8329b004d603', 'c3e6d6b5-67db-4c93-a420-962fa5678001', 'b40c065d-cb88-4bf9-9f5d-79045b81816e', 'db337f94-b11a-4142-9b16-0fce95d7c08d'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:33:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-652f4cbc-60ca-42de-af40-cfba03245cc1 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:33:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-652f4cbc-60ca-42de-af40-cfba03245cc1 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:33:50 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-652f4cbc-60ca-42de-af40-cfba03245cc1 tempest-ProjectMemberTests-1041831846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:33:50 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-652f4cbc-60ca-42de-af40-cfba03245cc1 tempest-ProjectMemberTests-1041831846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:33:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-652f4cbc-60ca-42de-af40-cfba03245cc1 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:33:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-652f4cbc-60ca-42de-af40-cfba03245cc1 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:50 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:33:50 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:50 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c29e34f9-25e7-48df-a45b-7b77ee30f131 tempest-ProjectReaderTests-1627580717 None] Acquiring lock "cinder-34a55140-cd23-418f-9868-9611648af754-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:50 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c29e34f9-25e7-48df-a45b-7b77ee30f131 tempest-ProjectReaderTests-1627580717 None] Lock "cinder-34a55140-cd23-418f-9868-9611648af754-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:50 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c29e34f9-25e7-48df-a45b-7b77ee30f131 tempest-ProjectReaderTests-1627580717 None] Acquiring lock "cinder-quobyte-34a55140-cd23-418f-9868-9611648af754" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:50 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c29e34f9-25e7-48df-a45b-7b77ee30f131 tempest-ProjectReaderTests-1627580717 None] Lock "cinder-quobyte-34a55140-cd23-418f-9868-9611648af754" acquired by "delete_volume" :: waited 0.016s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:50 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[c503cd83-1280-4b36-8d24-d016f0b37d4a]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:33:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c29e34f9-25e7-48df-a45b-7b77ee30f131 tempest-ProjectReaderTests-1627580717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-34a55140-cd23-418f-9868-9611648af754 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:50 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-34a55140-cd23-418f-9868-9611648af754 Jul 10 18:33:50 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:50 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:50 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-652f4cbc-60ca-42de-af40-cfba03245cc1 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.732s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:50 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-652f4cbc-60ca-42de-af40-cfba03245cc1 tempest-ProjectMemberTests-1041831846 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:33:50 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-652f4cbc-60ca-42de-af40-cfba03245cc1 tempest-ProjectMemberTests-1041831846 None] Deleted volume successfully. Jul 10 18:33:51 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-652f4cbc-60ca-42de-af40-cfba03245cc1 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-01731498-833a-4496-a182-89fb731efadb-delete_volume" released by "delete_volume" :: held 2.575s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:51 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:33:51 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] Flow 'volume_create_manager' (e3c593f0-157d-43f2-93ba-abd9e509a304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:33:51 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07e02ab1-2376-4f2f-87da-ba1d72b4fade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:51 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07e02ab1-2376-4f2f-87da-ba1d72b4fade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-470461789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d4a1a1e-620b-430d-859d-5ed1f96652fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab5573a169b463e9ccae9d5c832530c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:33:51Z,use_quota=True,user_id='db9bc81f72324f5da33633fdc460fbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:51 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead2f0d2-0ff7-465b-95cf-13e9ae593fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:51 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead2f0d2-0ff7-465b-95cf-13e9ae593fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:51 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01293810-d5c6-47b7-ac24-ec247a23e85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:51 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01293810-d5c6-47b7-ac24-ec247a23e85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d4a1a1e-620b-430d-859d-5ed1f96652fe', 'volume_name': 'volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:51 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3836f885-8567-4b92-b7a2-05724897fadd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:51 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3836f885-8567-4b92-b7a2-05724897fadd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:51 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1185caab-6115-4e3b-878f-9e2f1456352f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:51 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] Volume 0d4a1a1e-620b-430d-859d-5ed1f96652fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe', 'volume_size': 1} Jul 10 18:33:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:33:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:33:51 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-470461789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d4a1a1e-620b-430d-859d-5ed1f96652fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab5573a169b463e9ccae9d5c832530c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:33:51Z,use_quota=True,user_id='db9bc81f72324f5da33633fdc460fbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:33:51 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] Creating volume 0d4a1a1e-620b-430d-859d-5ed1f96652fe {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:33:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:33:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:33:51 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:33:51 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:33:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:33:51 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:33:51 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:33:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:51 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe 1073741824 Jul 10 18:33:51 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:51 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c29e34f9-25e7-48df-a45b-7b77ee30f131 tempest-ProjectReaderTests-1627580717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-34a55140-cd23-418f-9868-9611648af754" returned: 0 in 0.803s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:51 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c29e34f9-25e7-48df-a45b-7b77ee30f131 tempest-ProjectReaderTests-1627580717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-34a55140-cd23-418f-9868-9611648af754 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:51 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-34a55140-cd23-418f-9868-9611648af754 Jul 10 18:33:51 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:52 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe 1073741824" returned: 0 in 0.842s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:52 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe Jul 10 18:33:52 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:52 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c29e34f9-25e7-48df-a45b-7b77ee30f131 tempest-ProjectReaderTests-1627580717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-34a55140-cd23-418f-9868-9611648af754" returned: 0 in 0.671s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c29e34f9-25e7-48df-a45b-7b77ee30f131 tempest-ProjectReaderTests-1627580717 None] Lock "cinder-quobyte-34a55140-cd23-418f-9868-9611648af754" released by "delete_volume" :: held 1.521s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:52 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-c29e34f9-25e7-48df-a45b-7b77ee30f131 tempest-ProjectReaderTests-1627580717 None] Created reservations ['8bbc5e06-6af1-4fb4-baa3-92266e122f60', 'ed139b9c-39fe-462e-bdd2-cbb64c14c109', '9ffee0aa-9d00-4c4a-af8c-2e035e578438', 'df7df6aa-521b-44c1-a5e0-427574d8bbbb'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:33:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c29e34f9-25e7-48df-a45b-7b77ee30f131 tempest-ProjectReaderTests-1627580717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:33:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c29e34f9-25e7-48df-a45b-7b77ee30f131 tempest-ProjectReaderTests-1627580717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:33:52 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c29e34f9-25e7-48df-a45b-7b77ee30f131 tempest-ProjectReaderTests-1627580717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:33:52 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-c29e34f9-25e7-48df-a45b-7b77ee30f131 tempest-ProjectReaderTests-1627580717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:33:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-c29e34f9-25e7-48df-a45b-7b77ee30f131 tempest-ProjectReaderTests-1627580717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:33:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c29e34f9-25e7-48df-a45b-7b77ee30f131 tempest-ProjectReaderTests-1627580717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:52 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:33:52 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:52 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe" returned: 0 in 0.669s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:52 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:33:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:33:52 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=117,cinder:INSERT=42,cinder:UPDATE=153,cinder:DELETE=10 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:33:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1185caab-6115-4e3b-878f-9e2f1456352f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae41e25-6aa9-46e7-bd92-6237657c51b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:33:52 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=116,cinder:INSERT=40,cinder:UPDATE=153,cinder:DELETE=13 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:33:52 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] Volume volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe (0d4a1a1e-620b-430d-859d-5ed1f96652fe): created successfully Jul 10 18:33:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ae41e25-6aa9-46e7-bd92-6237657c51b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:33:52 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] Flow 'volume_create_manager' (e3c593f0-157d-43f2-93ba-abd9e509a304) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:33:52 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-1f9df4a0-34ce-4747-93c1-cfeedb0fc64d tempest-ProjectMemberTests-1041831846 None] Created volume successfully. Jul 10 18:33:52 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:52 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-c29e34f9-25e7-48df-a45b-7b77ee30f131 tempest-ProjectReaderTests-1627580717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.656s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:52 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-c29e34f9-25e7-48df-a45b-7b77ee30f131 tempest-ProjectReaderTests-1627580717 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:33:52 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-c29e34f9-25e7-48df-a45b-7b77ee30f131 tempest-ProjectReaderTests-1627580717 None] Deleted volume successfully. Jul 10 18:33:52 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-c29e34f9-25e7-48df-a45b-7b77ee30f131 tempest-ProjectReaderTests-1627580717 None] Lock "cinder-34a55140-cd23-418f-9868-9611648af754-delete_volume" released by "delete_volume" :: held 2.395s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:33:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1eb15a00-62d0-4ddf-8860-85bb46fdc746 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:33:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1eb15a00-62d0-4ddf-8860-85bb46fdc746 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:33:53 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-1eb15a00-62d0-4ddf-8860-85bb46fdc746 tempest-ProjectMemberTests-1041831846 None] Creating offline snapshot 7166f6f6-2c67-43b9-a315-df41a5629fba of volume 0d4a1a1e-620b-430d-859d-5ed1f96652fe {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:33:53 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7b02c9-3155-40c7-8d61-e72e0a3b5c5f]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:33:53 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1eb15a00-62d0-4ddf-8860-85bb46fdc746 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:53 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe Jul 10 18:33:53 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:54 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1eb15a00-62d0-4ddf-8860-85bb46fdc746 tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe" returned: 0 in 0.841s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:54 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1eb15a00-62d0-4ddf-8860-85bb46fdc746 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe.7166f6f6-2c67-43b9-a315-df41a5629fba 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:54 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe.7166f6f6-2c67-43b9-a315-df41a5629fba 1G Jul 10 18:33:54 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:55 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1eb15a00-62d0-4ddf-8860-85bb46fdc746 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe.7166f6f6-2c67-43b9-a315-df41a5629fba 1G" returned: 0 in 0.817s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1eb15a00-62d0-4ddf-8860-85bb46fdc746 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe.7166f6f6-2c67-43b9-a315-df41a5629fba {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:55 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe.7166f6f6-2c67-43b9-a315-df41a5629fba Jul 10 18:33:55 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:55 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1eb15a00-62d0-4ddf-8860-85bb46fdc746 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe.7166f6f6-2c67-43b9-a315-df41a5629fba" returned: 0 in 0.698s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:55 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-1eb15a00-62d0-4ddf-8860-85bb46fdc746 tempest-ProjectMemberTests-1041831846 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe.7166f6f6-2c67-43b9-a315-df41a5629fba is being set with open permissions: ugo+rw Jul 10 18:33:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1eb15a00-62d0-4ddf-8860-85bb46fdc746 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe.7166f6f6-2c67-43b9-a315-df41a5629fba {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:55 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe.7166f6f6-2c67-43b9-a315-df41a5629fba Jul 10 18:33:55 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:56 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1eb15a00-62d0-4ddf-8860-85bb46fdc746 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe.7166f6f6-2c67-43b9-a315-df41a5629fba" returned: 0 in 0.637s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1eb15a00-62d0-4ddf-8860-85bb46fdc746 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:56 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe.info Jul 10 18:33:56 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:57 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1eb15a00-62d0-4ddf-8860-85bb46fdc746 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe.info" returned: 0 in 0.638s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:57 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-1eb15a00-62d0-4ddf-8860-85bb46fdc746 tempest-ProjectMemberTests-1041831846 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe.info is being set with open permissions: ugo+rw Jul 10 18:33:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1eb15a00-62d0-4ddf-8860-85bb46fdc746 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:57 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe.info Jul 10 18:33:57 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:57 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:33:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:33:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:33:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:33:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:33:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:33:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:57 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:33:57 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:57 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1eb15a00-62d0-4ddf-8860-85bb46fdc746 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe.info" returned: 0 in 0.615s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1eb15a00-62d0-4ddf-8860-85bb46fdc746 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.340s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:33:57 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-1eb15a00-62d0-4ddf-8860-85bb46fdc746 tempest-ProjectMemberTests-1041831846 None] Create snapshot completed successfully Jul 10 18:33:58 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.652s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:58 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:33:58 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager._thread_info {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:33:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread count: 28 {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 18:33:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread info: [<_MainThread(MainThread, started 139757428633728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 18:33:58 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3434a45a-3367-4a6f-bb43-ef8dc9122003 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-7166f6f6-2c67-43b9-a315-df41a5629fba-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:58 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3434a45a-3367-4a6f-bb43-ef8dc9122003 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-7166f6f6-2c67-43b9-a315-df41a5629fba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:58 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3434a45a-3367-4a6f-bb43-ef8dc9122003 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-quobyte-0d4a1a1e-620b-430d-859d-5ed1f96652fe" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:58 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3434a45a-3367-4a6f-bb43-ef8dc9122003 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-0d4a1a1e-620b-430d-859d-5ed1f96652fe" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:58 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3434a45a-3367-4a6f-bb43-ef8dc9122003 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-quobyte-7166f6f6-2c67-43b9-a315-df41a5629fba" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:33:58 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3434a45a-3367-4a6f-bb43-ef8dc9122003 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-7166f6f6-2c67-43b9-a315-df41a5629fba" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:33:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-3434a45a-3367-4a6f-bb43-ef8dc9122003 tempest-ProjectMemberTests-1041831846 None] Deleting offline snapshot 7166f6f6-2c67-43b9-a315-df41a5629fba of volume 0d4a1a1e-620b-430d-859d-5ed1f96652fe {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:33:58 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-3434a45a-3367-4a6f-bb43-ef8dc9122003 tempest-ProjectMemberTests-1041831846 None] snapshot_file for this snap is: volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe.7166f6f6-2c67-43b9-a315-df41a5629fba {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:33:58 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[7558dc9a-d831-4cf6-bdd2-28c410614f7d]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:33:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3434a45a-3367-4a6f-bb43-ef8dc9122003 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe.7166f6f6-2c67-43b9-a315-df41a5629fba {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:58 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe.7166f6f6-2c67-43b9-a315-df41a5629fba Jul 10 18:33:58 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:33:59 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Jul 10 18:33:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3434a45a-3367-4a6f-bb43-ef8dc9122003 tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe.7166f6f6-2c67-43b9-a315-df41a5629fba" returned: 0 in 0.731s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:33:59 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-3434a45a-3367-4a6f-bb43-ef8dc9122003 tempest-ProjectMemberTests-1041831846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:33:59 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[9096104c-0593-4696-8466-63a1df239bd2]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:33:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3434a45a-3367-4a6f-bb43-ef8dc9122003 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:33:59 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe Jul 10 18:33:59 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:00 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3434a45a-3367-4a6f-bb43-ef8dc9122003 tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe" returned: 0 in 0.765s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3434a45a-3367-4a6f-bb43-ef8dc9122003 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe.7166f6f6-2c67-43b9-a315-df41a5629fba {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:00 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe.7166f6f6-2c67-43b9-a315-df41a5629fba Jul 10 18:34:00 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:00 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3434a45a-3367-4a6f-bb43-ef8dc9122003 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe.7166f6f6-2c67-43b9-a315-df41a5629fba" returned: 0 in 0.729s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3434a45a-3367-4a6f-bb43-ef8dc9122003 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe.7166f6f6-2c67-43b9-a315-df41a5629fba {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:00 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe.7166f6f6-2c67-43b9-a315-df41a5629fba Jul 10 18:34:00 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:01 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3434a45a-3367-4a6f-bb43-ef8dc9122003 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe.7166f6f6-2c67-43b9-a315-df41a5629fba" returned: 0 in 0.654s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3434a45a-3367-4a6f-bb43-ef8dc9122003 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-7166f6f6-2c67-43b9-a315-df41a5629fba" released by "_delete_snapshot" :: held 2.971s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:34:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3434a45a-3367-4a6f-bb43-ef8dc9122003 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-0d4a1a1e-620b-430d-859d-5ed1f96652fe" released by "delete_snapshot" :: held 2.998s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:34:01 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-3434a45a-3367-4a6f-bb43-ef8dc9122003 tempest-ProjectMemberTests-1041831846 None] Created reservations ['e9aa7e28-c466-4b0d-936c-aef9fce5e1f4', 'f24b1dc9-0417-4b24-bd4e-d2f4bebb2bbc', '6383f251-43d6-4a35-8d73-cfe3949be2b4', 'e646dde0-39b8-49b9-b4fd-4eb1b9f5d073'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:34:01 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-3434a45a-3367-4a6f-bb43-ef8dc9122003 tempest-ProjectMemberTests-1041831846 None] Delete snapshot completed successfully. Jul 10 18:34:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3434a45a-3367-4a6f-bb43-ef8dc9122003 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-7166f6f6-2c67-43b9-a315-df41a5629fba-delete_snapshot" released by "delete_snapshot" :: held 3.135s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:34:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3b83138c-5c41-4e7d-bf59-33acf66c8f0c tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-0d4a1a1e-620b-430d-859d-5ed1f96652fe-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:34:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3b83138c-5c41-4e7d-bf59-33acf66c8f0c tempest-ProjectMemberTests-1041831846 None] Lock "cinder-0d4a1a1e-620b-430d-859d-5ed1f96652fe-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:34:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3b83138c-5c41-4e7d-bf59-33acf66c8f0c tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-quobyte-0d4a1a1e-620b-430d-859d-5ed1f96652fe" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:34:01 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3b83138c-5c41-4e7d-bf59-33acf66c8f0c tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-0d4a1a1e-620b-430d-859d-5ed1f96652fe" acquired by "delete_volume" :: waited 0.013s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:34:01 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[c993a933-ea6d-4ccc-8562-213e66906eb3]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:34:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3b83138c-5c41-4e7d-bf59-33acf66c8f0c tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:02 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe Jul 10 18:34:02 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:02 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3b83138c-5c41-4e7d-bf59-33acf66c8f0c tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe" returned: 0 in 0.736s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3b83138c-5c41-4e7d-bf59-33acf66c8f0c tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:02 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe Jul 10 18:34:02 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:03 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3b83138c-5c41-4e7d-bf59-33acf66c8f0c tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-0d4a1a1e-620b-430d-859d-5ed1f96652fe" returned: 0 in 0.622s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:03 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3b83138c-5c41-4e7d-bf59-33acf66c8f0c tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-0d4a1a1e-620b-430d-859d-5ed1f96652fe" released by "delete_volume" :: held 1.423s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:34:03 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-3b83138c-5c41-4e7d-bf59-33acf66c8f0c tempest-ProjectMemberTests-1041831846 None] Created reservations ['9d9f6bb4-6309-43a1-bc07-435abab1b0a0', '87e769c2-cbc3-4c0b-a703-e5d0aa87ba2f', '92c2d8df-723b-4a5c-a577-fba802ffcdf1', 'c4235db3-650e-4d4d-9ea4-3b4a5daea2b9'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:34:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3b83138c-5c41-4e7d-bf59-33acf66c8f0c tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:34:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3b83138c-5c41-4e7d-bf59-33acf66c8f0c tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:34:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-3b83138c-5c41-4e7d-bf59-33acf66c8f0c tempest-ProjectMemberTests-1041831846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:34:03 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-3b83138c-5c41-4e7d-bf59-33acf66c8f0c tempest-ProjectMemberTests-1041831846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:34:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3b83138c-5c41-4e7d-bf59-33acf66c8f0c tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:34:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3b83138c-5c41-4e7d-bf59-33acf66c8f0c tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:03 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:34:03 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:04 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3b83138c-5c41-4e7d-bf59-33acf66c8f0c tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.667s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:04 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-3b83138c-5c41-4e7d-bf59-33acf66c8f0c tempest-ProjectMemberTests-1041831846 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:34:04 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-3b83138c-5c41-4e7d-bf59-33acf66c8f0c tempest-ProjectMemberTests-1041831846 None] Deleted volume successfully. Jul 10 18:34:04 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-3b83138c-5c41-4e7d-bf59-33acf66c8f0c tempest-ProjectMemberTests-1041831846 None] Lock "cinder-0d4a1a1e-620b-430d-859d-5ed1f96652fe-delete_volume" released by "delete_volume" :: held 2.286s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:34:04 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:34:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] Flow 'volume_create_manager' (bb52a60b-3ec2-4627-bb06-b2938aba1636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:34:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3da6a5b-5864-4092-9617-2fff534f44ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:34:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3da6a5b-5864-4092-9617-2fff534f44ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-356721013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eb1efb3-56f3-4aa5-b50f-ed577b1ce619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab5573a169b463e9ccae9d5c832530c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:34:04Z,use_quota=True,user_id='db9bc81f72324f5da33633fdc460fbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:34:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cbe9be1-955d-4cc4-9d37-09022c5de862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:34:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cbe9be1-955d-4cc4-9d37-09022c5de862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:34:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f120e0dc-56c9-46aa-9de0-6d7000b8175b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:34:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f120e0dc-56c9-46aa-9de0-6d7000b8175b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eb1efb3-56f3-4aa5-b50f-ed577b1ce619', 'volume_name': 'volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:34:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caa14b2a-7201-48d9-86c9-0e3f7c51f247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:34:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caa14b2a-7201-48d9-86c9-0e3f7c51f247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:34:04 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00149f6d-22ac-40f8-8a89-04257aad2ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:34:04 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] Volume 6eb1efb3-56f3-4aa5-b50f-ed577b1ce619: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619', 'volume_size': 1} Jul 10 18:34:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:34:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:34:04 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-356721013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eb1efb3-56f3-4aa5-b50f-ed577b1ce619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab5573a169b463e9ccae9d5c832530c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:34:04Z,use_quota=True,user_id='db9bc81f72324f5da33633fdc460fbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:34:04 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] Creating volume 6eb1efb3-56f3-4aa5-b50f-ed577b1ce619 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:34:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:34:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:34:04 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:34:04 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:34:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:34:04 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:34:04 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:34:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:04 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619 1073741824 Jul 10 18:34:04 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:05 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619 1073741824" returned: 0 in 0.830s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:05 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619 Jul 10 18:34:05 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:06 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619" returned: 0 in 0.646s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:34:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:34:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00149f6d-22ac-40f8-8a89-04257aad2ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:34:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3099f44-77d6-4c72-aebc-cd64a6a9ef14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:34:06 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] Volume volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619 (6eb1efb3-56f3-4aa5-b50f-ed577b1ce619): created successfully Jul 10 18:34:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3099f44-77d6-4c72-aebc-cd64a6a9ef14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:34:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] Flow 'volume_create_manager' (bb52a60b-3ec2-4627-bb06-b2938aba1636) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:34:06 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-76f6fc55-54c1-4136-b09a-bcee771921bc tempest-ProjectMemberTests-1041831846 None] Created volume successfully. Jul 10 18:34:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-88ca1a57-736b-465a-8e6d-52fdc7bcf8c3 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:34:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-88ca1a57-736b-465a-8e6d-52fdc7bcf8c3 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:34:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-88ca1a57-736b-465a-8e6d-52fdc7bcf8c3 tempest-ProjectMemberTests-1041831846 None] Creating offline snapshot bc7f71f2-f781-466d-b13c-a13e323c102b of volume 6eb1efb3-56f3-4aa5-b50f-ed577b1ce619 {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:34:06 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7a019c-d16a-4bd1-81c1-3b2ba5d3d786]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:34:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-88ca1a57-736b-465a-8e6d-52fdc7bcf8c3 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:06 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619 Jul 10 18:34:06 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:07 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-88ca1a57-736b-465a-8e6d-52fdc7bcf8c3 tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619" returned: 0 in 0.773s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-88ca1a57-736b-465a-8e6d-52fdc7bcf8c3 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619.bc7f71f2-f781-466d-b13c-a13e323c102b 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:07 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619.bc7f71f2-f781-466d-b13c-a13e323c102b 1G Jul 10 18:34:07 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:08 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-88ca1a57-736b-465a-8e6d-52fdc7bcf8c3 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619.bc7f71f2-f781-466d-b13c-a13e323c102b 1G" returned: 0 in 0.783s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-88ca1a57-736b-465a-8e6d-52fdc7bcf8c3 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619.bc7f71f2-f781-466d-b13c-a13e323c102b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:08 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619.bc7f71f2-f781-466d-b13c-a13e323c102b Jul 10 18:34:08 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:08 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-88ca1a57-736b-465a-8e6d-52fdc7bcf8c3 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619 -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619.bc7f71f2-f781-466d-b13c-a13e323c102b" returned: 0 in 0.661s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:08 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-88ca1a57-736b-465a-8e6d-52fdc7bcf8c3 tempest-ProjectMemberTests-1041831846 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619.bc7f71f2-f781-466d-b13c-a13e323c102b is being set with open permissions: ugo+rw Jul 10 18:34:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-88ca1a57-736b-465a-8e6d-52fdc7bcf8c3 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619.bc7f71f2-f781-466d-b13c-a13e323c102b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:08 devstack sudo[107764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619.bc7f71f2-f781-466d-b13c-a13e323c102b Jul 10 18:34:08 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:09 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-88ca1a57-736b-465a-8e6d-52fdc7bcf8c3 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619.bc7f71f2-f781-466d-b13c-a13e323c102b" returned: 0 in 0.628s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-88ca1a57-736b-465a-8e6d-52fdc7bcf8c3 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:09 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619.info Jul 10 18:34:09 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:10 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-88ca1a57-736b-465a-8e6d-52fdc7bcf8c3 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619.info" returned: 0 in 0.647s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:10 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-88ca1a57-736b-465a-8e6d-52fdc7bcf8c3 tempest-ProjectMemberTests-1041831846 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619.info is being set with open permissions: ugo+rw Jul 10 18:34:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-88ca1a57-736b-465a-8e6d-52fdc7bcf8c3 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:10 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619.info Jul 10 18:34:10 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:10 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-88ca1a57-736b-465a-8e6d-52fdc7bcf8c3 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619.info" returned: 0 in 0.647s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-88ca1a57-736b-465a-8e6d-52fdc7bcf8c3 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.214s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:34:10 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-88ca1a57-736b-465a-8e6d-52fdc7bcf8c3 tempest-ProjectMemberTests-1041831846 None] Create snapshot completed successfully Jul 10 18:34:11 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-bd407e01-b109-4c3c-a97c-07f2c7a78daf tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-bc7f71f2-f781-466d-b13c-a13e323c102b-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:34:11 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-bd407e01-b109-4c3c-a97c-07f2c7a78daf tempest-ProjectMemberTests-1041831846 None] Lock "cinder-bc7f71f2-f781-466d-b13c-a13e323c102b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:34:11 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-bd407e01-b109-4c3c-a97c-07f2c7a78daf tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-quobyte-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:34:11 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-bd407e01-b109-4c3c-a97c-07f2c7a78daf tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:34:11 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-bd407e01-b109-4c3c-a97c-07f2c7a78daf tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-quobyte-bc7f71f2-f781-466d-b13c-a13e323c102b" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:34:11 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-bd407e01-b109-4c3c-a97c-07f2c7a78daf tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-bc7f71f2-f781-466d-b13c-a13e323c102b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:34:11 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-bd407e01-b109-4c3c-a97c-07f2c7a78daf tempest-ProjectMemberTests-1041831846 None] Deleting offline snapshot bc7f71f2-f781-466d-b13c-a13e323c102b of volume 6eb1efb3-56f3-4aa5-b50f-ed577b1ce619 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:34:11 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-bd407e01-b109-4c3c-a97c-07f2c7a78daf tempest-ProjectMemberTests-1041831846 None] snapshot_file for this snap is: volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619.bc7f71f2-f781-466d-b13c-a13e323c102b {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:34:11 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d08223-fc69-402d-8fde-4265bad29da6]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:34:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bd407e01-b109-4c3c-a97c-07f2c7a78daf tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619.bc7f71f2-f781-466d-b13c-a13e323c102b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:12 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619.bc7f71f2-f781-466d-b13c-a13e323c102b Jul 10 18:34:12 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:12 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bd407e01-b109-4c3c-a97c-07f2c7a78daf tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619.bc7f71f2-f781-466d-b13c-a13e323c102b" returned: 0 in 0.740s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:12 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-bd407e01-b109-4c3c-a97c-07f2c7a78daf tempest-ProjectMemberTests-1041831846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:34:12 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e09977-8c29-4f84-9719-582a52cc51aa]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:34:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bd407e01-b109-4c3c-a97c-07f2c7a78daf tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:12 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619 Jul 10 18:34:12 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:13 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bd407e01-b109-4c3c-a97c-07f2c7a78daf tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619" returned: 0 in 0.719s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bd407e01-b109-4c3c-a97c-07f2c7a78daf tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619.bc7f71f2-f781-466d-b13c-a13e323c102b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:13 devstack sudo[107783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619.bc7f71f2-f781-466d-b13c-a13e323c102b Jul 10 18:34:13 devstack sudo[107783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:14 devstack sudo[107783]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bd407e01-b109-4c3c-a97c-07f2c7a78daf tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619.bc7f71f2-f781-466d-b13c-a13e323c102b" returned: 0 in 0.725s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bd407e01-b109-4c3c-a97c-07f2c7a78daf tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619.bc7f71f2-f781-466d-b13c-a13e323c102b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:14 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619.bc7f71f2-f781-466d-b13c-a13e323c102b Jul 10 18:34:14 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:14 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bd407e01-b109-4c3c-a97c-07f2c7a78daf tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619.bc7f71f2-f781-466d-b13c-a13e323c102b" returned: 0 in 0.625s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:14 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-bd407e01-b109-4c3c-a97c-07f2c7a78daf tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-bc7f71f2-f781-466d-b13c-a13e323c102b" released by "_delete_snapshot" :: held 2.897s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:34:14 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-bd407e01-b109-4c3c-a97c-07f2c7a78daf tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619" released by "delete_snapshot" :: held 2.917s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:34:14 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-bd407e01-b109-4c3c-a97c-07f2c7a78daf tempest-ProjectMemberTests-1041831846 None] Created reservations ['9e1113fc-ec85-4703-8fdc-7b40e697a6ba', '4ae5a9b5-608e-48ff-915d-1dc70a2ad9b5', 'bf7e82dc-db8c-4485-933d-fbf1114fa7bf', '5077bca0-449f-4d03-9bde-0cd591a60018'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:34:14 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-bd407e01-b109-4c3c-a97c-07f2c7a78daf tempest-ProjectMemberTests-1041831846 None] Delete snapshot completed successfully. Jul 10 18:34:14 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-bd407e01-b109-4c3c-a97c-07f2c7a78daf tempest-ProjectMemberTests-1041831846 None] Lock "cinder-bc7f71f2-f781-466d-b13c-a13e323c102b-delete_snapshot" released by "delete_snapshot" :: held 3.040s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:34:15 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7625cbe5-4c74-48db-bb4b-2ca0fb2bd212 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:34:15 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7625cbe5-4c74-48db-bb4b-2ca0fb2bd212 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:34:15 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7625cbe5-4c74-48db-bb4b-2ca0fb2bd212 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-quobyte-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:34:15 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7625cbe5-4c74-48db-bb4b-2ca0fb2bd212 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619" acquired by "delete_volume" :: waited 0.015s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:34:15 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c4fae4-28b1-40f4-887d-6ba656694d46]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:34:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7625cbe5-4c74-48db-bb4b-2ca0fb2bd212 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:15 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619 Jul 10 18:34:15 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:15 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7625cbe5-4c74-48db-bb4b-2ca0fb2bd212 tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619" returned: 0 in 0.762s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:15 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7625cbe5-4c74-48db-bb4b-2ca0fb2bd212 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:15 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619 Jul 10 18:34:15 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:16 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7625cbe5-4c74-48db-bb4b-2ca0fb2bd212 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619" returned: 0 in 0.642s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:16 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7625cbe5-4c74-48db-bb4b-2ca0fb2bd212 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619" released by "delete_volume" :: held 1.458s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:34:16 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-7625cbe5-4c74-48db-bb4b-2ca0fb2bd212 tempest-ProjectMemberTests-1041831846 None] Created reservations ['cadec441-a091-4657-b0bd-2a4d9b29a362', '15e0353a-8af9-404e-9d00-fffb97812230', '142df116-ac70-4da4-9b22-d9e18c841093', '175d2284-023c-425d-81a0-89893e0439db'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:34:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7625cbe5-4c74-48db-bb4b-2ca0fb2bd212 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:34:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7625cbe5-4c74-48db-bb4b-2ca0fb2bd212 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:34:16 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7625cbe5-4c74-48db-bb4b-2ca0fb2bd212 tempest-ProjectMemberTests-1041831846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:34:16 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7625cbe5-4c74-48db-bb4b-2ca0fb2bd212 tempest-ProjectMemberTests-1041831846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:34:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7625cbe5-4c74-48db-bb4b-2ca0fb2bd212 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:34:16 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7625cbe5-4c74-48db-bb4b-2ca0fb2bd212 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:16 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:34:16 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:17 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7625cbe5-4c74-48db-bb4b-2ca0fb2bd212 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.633s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:17 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-7625cbe5-4c74-48db-bb4b-2ca0fb2bd212 tempest-ProjectMemberTests-1041831846 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:34:17 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-7625cbe5-4c74-48db-bb4b-2ca0fb2bd212 tempest-ProjectMemberTests-1041831846 None] Deleted volume successfully. Jul 10 18:34:17 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7625cbe5-4c74-48db-bb4b-2ca0fb2bd212 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-6eb1efb3-56f3-4aa5-b50f-ed577b1ce619-delete_volume" released by "delete_volume" :: held 2.284s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:34:17 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:34:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] Flow 'volume_create_manager' (a6fcdf26-825f-415e-810f-f98552200b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:34:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (988f4905-270b-496d-ae1e-9e876507741b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:34:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (988f4905-270b-496d-ae1e-9e876507741b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-417110632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9275e7a9-8ced-4b6a-b129-a2f3e942ab0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab5573a169b463e9ccae9d5c832530c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:34:18Z,use_quota=True,user_id='db9bc81f72324f5da33633fdc460fbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:34:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a80285-38d6-4d38-b38b-ad733c1584ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:34:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a80285-38d6-4d38-b38b-ad733c1584ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:34:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50321798-cb5e-4ac4-b8b9-2337a54a18f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:34:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50321798-cb5e-4ac4-b8b9-2337a54a18f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9275e7a9-8ced-4b6a-b129-a2f3e942ab0e', 'volume_name': 'volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:34:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e64017c-8596-4656-a975-dc64cd2bd5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:34:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e64017c-8596-4656-a975-dc64cd2bd5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:34:17 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc4f5ce-3458-48a8-a434-f68fb2589ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:34:17 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] Volume 9275e7a9-8ced-4b6a-b129-a2f3e942ab0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e', 'volume_size': 1} Jul 10 18:34:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:34:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:34:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-417110632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9275e7a9-8ced-4b6a-b129-a2f3e942ab0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab5573a169b463e9ccae9d5c832530c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:34:18Z,use_quota=True,user_id='db9bc81f72324f5da33633fdc460fbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:34:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] Creating volume 9275e7a9-8ced-4b6a-b129-a2f3e942ab0e {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:34:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:34:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:34:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:34:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:34:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:34:17 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:34:17 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:34:17 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:17 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e 1073741824 Jul 10 18:34:17 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:18 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e 1073741824" returned: 0 in 0.818s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:18 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:18 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e Jul 10 18:34:18 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:19 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e" returned: 0 in 0.675s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:19 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:34:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:34:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc4f5ce-3458-48a8-a434-f68fb2589ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:34:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffe5fb0b-0733-47d1-9d62-ed099bf6bd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:34:19 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] Volume volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e (9275e7a9-8ced-4b6a-b129-a2f3e942ab0e): created successfully Jul 10 18:34:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffe5fb0b-0733-47d1-9d62-ed099bf6bd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:34:19 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] Flow 'volume_create_manager' (a6fcdf26-825f-415e-810f-f98552200b86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:34:19 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-5a482499-bd63-408c-85c2-d16b6ccb2c44 tempest-ProjectMemberTests-1041831846 None] Created volume successfully. Jul 10 18:34:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-62240eff-f317-4f24-a4ef-082d5274cc69 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:34:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-62240eff-f317-4f24-a4ef-082d5274cc69 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:34:19 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-62240eff-f317-4f24-a4ef-082d5274cc69 tempest-ProjectMemberTests-1041831846 None] Creating offline snapshot f5bb7e01-ef4f-4ce1-9cd4-99f64f81a082 of volume 9275e7a9-8ced-4b6a-b129-a2f3e942ab0e {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:34:19 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fad0d5-f3c1-4cb5-bfa8-a7879048f444]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:34:19 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-62240eff-f317-4f24-a4ef-082d5274cc69 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:20 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e Jul 10 18:34:20 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:20 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-62240eff-f317-4f24-a4ef-082d5274cc69 tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e" returned: 0 in 0.763s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:20 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-62240eff-f317-4f24-a4ef-082d5274cc69 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e.f5bb7e01-ef4f-4ce1-9cd4-99f64f81a082 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:20 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e.f5bb7e01-ef4f-4ce1-9cd4-99f64f81a082 1G Jul 10 18:34:20 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:21 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-62240eff-f317-4f24-a4ef-082d5274cc69 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e.f5bb7e01-ef4f-4ce1-9cd4-99f64f81a082 1G" returned: 0 in 0.785s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:21 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-62240eff-f317-4f24-a4ef-082d5274cc69 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e.f5bb7e01-ef4f-4ce1-9cd4-99f64f81a082 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:21 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e.f5bb7e01-ef4f-4ce1-9cd4-99f64f81a082 Jul 10 18:34:21 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:22 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-62240eff-f317-4f24-a4ef-082d5274cc69 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e.f5bb7e01-ef4f-4ce1-9cd4-99f64f81a082" returned: 0 in 0.667s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:22 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-62240eff-f317-4f24-a4ef-082d5274cc69 tempest-ProjectMemberTests-1041831846 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e.f5bb7e01-ef4f-4ce1-9cd4-99f64f81a082 is being set with open permissions: ugo+rw Jul 10 18:34:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-62240eff-f317-4f24-a4ef-082d5274cc69 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e.f5bb7e01-ef4f-4ce1-9cd4-99f64f81a082 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:22 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e.f5bb7e01-ef4f-4ce1-9cd4-99f64f81a082 Jul 10 18:34:22 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:22 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-62240eff-f317-4f24-a4ef-082d5274cc69 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e.f5bb7e01-ef4f-4ce1-9cd4-99f64f81a082" returned: 0 in 0.629s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:22 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-62240eff-f317-4f24-a4ef-082d5274cc69 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:22 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e.info Jul 10 18:34:22 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:23 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-62240eff-f317-4f24-a4ef-082d5274cc69 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e.info" returned: 0 in 0.644s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:23 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-62240eff-f317-4f24-a4ef-082d5274cc69 tempest-ProjectMemberTests-1041831846 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e.info is being set with open permissions: ugo+rw Jul 10 18:34:23 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-62240eff-f317-4f24-a4ef-082d5274cc69 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:23 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e.info Jul 10 18:34:23 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:24 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-62240eff-f317-4f24-a4ef-082d5274cc69 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e.info" returned: 0 in 0.643s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:24 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-62240eff-f317-4f24-a4ef-082d5274cc69 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.209s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:34:24 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-62240eff-f317-4f24-a4ef-082d5274cc69 tempest-ProjectMemberTests-1041831846 None] Create snapshot completed successfully Jul 10 18:34:25 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2faa80da-e411-4b5f-b6eb-c5f1bfc44dc3 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-f5bb7e01-ef4f-4ce1-9cd4-99f64f81a082-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:34:25 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2faa80da-e411-4b5f-b6eb-c5f1bfc44dc3 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-f5bb7e01-ef4f-4ce1-9cd4-99f64f81a082-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:34:25 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2faa80da-e411-4b5f-b6eb-c5f1bfc44dc3 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-quobyte-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:34:25 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2faa80da-e411-4b5f-b6eb-c5f1bfc44dc3 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:34:25 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2faa80da-e411-4b5f-b6eb-c5f1bfc44dc3 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-quobyte-f5bb7e01-ef4f-4ce1-9cd4-99f64f81a082" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:34:25 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2faa80da-e411-4b5f-b6eb-c5f1bfc44dc3 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-f5bb7e01-ef4f-4ce1-9cd4-99f64f81a082" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:34:25 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-2faa80da-e411-4b5f-b6eb-c5f1bfc44dc3 tempest-ProjectMemberTests-1041831846 None] Deleting offline snapshot f5bb7e01-ef4f-4ce1-9cd4-99f64f81a082 of volume 9275e7a9-8ced-4b6a-b129-a2f3e942ab0e {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:34:25 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-2faa80da-e411-4b5f-b6eb-c5f1bfc44dc3 tempest-ProjectMemberTests-1041831846 None] snapshot_file for this snap is: volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e.f5bb7e01-ef4f-4ce1-9cd4-99f64f81a082 {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:34:25 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[9106503b-c274-4007-addf-d42f1768af28]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:34:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2faa80da-e411-4b5f-b6eb-c5f1bfc44dc3 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e.f5bb7e01-ef4f-4ce1-9cd4-99f64f81a082 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:25 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e.f5bb7e01-ef4f-4ce1-9cd4-99f64f81a082 Jul 10 18:34:25 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:25 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2faa80da-e411-4b5f-b6eb-c5f1bfc44dc3 tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e.f5bb7e01-ef4f-4ce1-9cd4-99f64f81a082" returned: 0 in 0.757s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:25 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-2faa80da-e411-4b5f-b6eb-c5f1bfc44dc3 tempest-ProjectMemberTests-1041831846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:34:25 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bf1c7e-9d49-4cf7-a691-4c98840812a4]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:34:25 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2faa80da-e411-4b5f-b6eb-c5f1bfc44dc3 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:26 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e Jul 10 18:34:26 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:26 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2faa80da-e411-4b5f-b6eb-c5f1bfc44dc3 tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e" returned: 0 in 0.744s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:26 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2faa80da-e411-4b5f-b6eb-c5f1bfc44dc3 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e.f5bb7e01-ef4f-4ce1-9cd4-99f64f81a082 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:26 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e.f5bb7e01-ef4f-4ce1-9cd4-99f64f81a082 Jul 10 18:34:26 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:27 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2faa80da-e411-4b5f-b6eb-c5f1bfc44dc3 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e.f5bb7e01-ef4f-4ce1-9cd4-99f64f81a082" returned: 0 in 0.699s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:27 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2faa80da-e411-4b5f-b6eb-c5f1bfc44dc3 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e.f5bb7e01-ef4f-4ce1-9cd4-99f64f81a082 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:27 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e.f5bb7e01-ef4f-4ce1-9cd4-99f64f81a082 Jul 10 18:34:27 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:28 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-2faa80da-e411-4b5f-b6eb-c5f1bfc44dc3 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e.f5bb7e01-ef4f-4ce1-9cd4-99f64f81a082" returned: 0 in 0.621s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:28 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2faa80da-e411-4b5f-b6eb-c5f1bfc44dc3 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-f5bb7e01-ef4f-4ce1-9cd4-99f64f81a082" released by "_delete_snapshot" :: held 2.907s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:34:28 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2faa80da-e411-4b5f-b6eb-c5f1bfc44dc3 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e" released by "delete_snapshot" :: held 2.926s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:34:28 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-2faa80da-e411-4b5f-b6eb-c5f1bfc44dc3 tempest-ProjectMemberTests-1041831846 None] Created reservations ['90a61c6a-4115-41c4-9e20-4086b8979d85', '021b023f-ad6e-4aad-b291-eb152004959a', '3d306b36-a985-4c01-a9e6-b6fff6e2f148', '7e673f73-164b-4b3b-a8f2-55e4e560d500'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:34:28 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-2faa80da-e411-4b5f-b6eb-c5f1bfc44dc3 tempest-ProjectMemberTests-1041831846 None] Delete snapshot completed successfully. Jul 10 18:34:28 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-2faa80da-e411-4b5f-b6eb-c5f1bfc44dc3 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-f5bb7e01-ef4f-4ce1-9cd4-99f64f81a082-delete_snapshot" released by "delete_snapshot" :: held 3.050s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:34:28 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1244c5b3-d416-478b-bc8a-f3f07424b681 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:34:28 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1244c5b3-d416-478b-bc8a-f3f07424b681 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:34:28 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1244c5b3-d416-478b-bc8a-f3f07424b681 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-quobyte-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:34:28 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1244c5b3-d416-478b-bc8a-f3f07424b681 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e" acquired by "delete_volume" :: waited 0.016s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:34:28 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[182e46fe-0848-4a6f-98a6-e0edd83b9ce7]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:34:28 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1244c5b3-d416-478b-bc8a-f3f07424b681 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:28 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e Jul 10 18:34:28 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:29 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1244c5b3-d416-478b-bc8a-f3f07424b681 tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e" returned: 0 in 0.722s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1244c5b3-d416-478b-bc8a-f3f07424b681 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:29 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e Jul 10 18:34:29 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:29 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1244c5b3-d416-478b-bc8a-f3f07424b681 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e" returned: 0 in 0.646s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:29 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1244c5b3-d416-478b-bc8a-f3f07424b681 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e" released by "delete_volume" :: held 1.426s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:34:29 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-1244c5b3-d416-478b-bc8a-f3f07424b681 tempest-ProjectMemberTests-1041831846 None] Created reservations ['fedc9680-bf58-4de6-951d-268df1f238e7', '351dea9a-9cc8-4df8-b862-ead791e67777', '4cbe32c0-78f3-4e54-a97b-5ab394528606', '96c0cf91-e98a-44f5-be79-3bc0ed83d68a'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:34:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1244c5b3-d416-478b-bc8a-f3f07424b681 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:34:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1244c5b3-d416-478b-bc8a-f3f07424b681 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:34:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1244c5b3-d416-478b-bc8a-f3f07424b681 tempest-ProjectMemberTests-1041831846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:34:29 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1244c5b3-d416-478b-bc8a-f3f07424b681 tempest-ProjectMemberTests-1041831846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:34:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1244c5b3-d416-478b-bc8a-f3f07424b681 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:34:29 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1244c5b3-d416-478b-bc8a-f3f07424b681 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:29 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:34:29 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:30 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:30 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1244c5b3-d416-478b-bc8a-f3f07424b681 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.656s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:30 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-1244c5b3-d416-478b-bc8a-f3f07424b681 tempest-ProjectMemberTests-1041831846 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:34:30 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-1244c5b3-d416-478b-bc8a-f3f07424b681 tempest-ProjectMemberTests-1041831846 None] Deleted volume successfully. Jul 10 18:34:30 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-1244c5b3-d416-478b-bc8a-f3f07424b681 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-9275e7a9-8ced-4b6a-b129-a2f3e942ab0e-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:34:30 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:34:30 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] Flow 'volume_create_manager' (4251565a-4a3c-4b06-95ce-aa3156f8affc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:34:30 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cdbbad2-2ab8-486b-a6fd-2a62e1547aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:34:30 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cdbbad2-2ab8-486b-a6fd-2a62e1547aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-102512799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47efa002-677c-4574-b6fd-97ebb54f361b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab5573a169b463e9ccae9d5c832530c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:34:31Z,use_quota=True,user_id='db9bc81f72324f5da33633fdc460fbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:34:30 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (680f8125-d740-4c0e-85ee-8581fc407c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:34:30 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (680f8125-d740-4c0e-85ee-8581fc407c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:34:30 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3c4fd29-7260-469f-b827-3cf801c7d99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:34:30 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3c4fd29-7260-469f-b827-3cf801c7d99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47efa002-677c-4574-b6fd-97ebb54f361b', 'volume_name': 'volume-47efa002-677c-4574-b6fd-97ebb54f361b', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:34:30 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfe857da-e0a7-4d43-a5f2-01d7ddb78be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:34:30 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfe857da-e0a7-4d43-a5f2-01d7ddb78be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:34:31 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee753c1-d91b-47c6-9f17-e27d5b978afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:34:31 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] Volume 47efa002-677c-4574-b6fd-97ebb54f361b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47efa002-677c-4574-b6fd-97ebb54f361b', 'volume_size': 1} Jul 10 18:34:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:34:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:34:31 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:34:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-102512799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47efa002-677c-4574-b6fd-97ebb54f361b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab5573a169b463e9ccae9d5c832530c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:34:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:34:31Z,use_quota=True,user_id='db9bc81f72324f5da33633fdc460fbfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:34:31 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] Creating volume 47efa002-677c-4574-b6fd-97ebb54f361b {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:34:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:34:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:34:31 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:34:31 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:34:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:34:31 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:34:31 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:34:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:31 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b 1073741824 Jul 10 18:34:31 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:31 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b 1073741824" returned: 0 in 0.823s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:31 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:31 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b Jul 10 18:34:31 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:32 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b" returned: 0 in 0.626s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:32 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:34:32 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:34:32 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee753c1-d91b-47c6-9f17-e27d5b978afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47efa002-677c-4574-b6fd-97ebb54f361b', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:34:32 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d9d92b-8a69-41c7-9663-0d0cae88177f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:34:32 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] Volume volume-47efa002-677c-4574-b6fd-97ebb54f361b (47efa002-677c-4574-b6fd-97ebb54f361b): created successfully Jul 10 18:34:32 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2d9d92b-8a69-41c7-9663-0d0cae88177f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:34:32 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] Flow 'volume_create_manager' (4251565a-4a3c-4b06-95ce-aa3156f8affc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:34:32 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-be813208-1278-4c03-9c2c-7074942fc9fd tempest-ProjectMemberTests-1041831846 None] Created volume successfully. Jul 10 18:34:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3eac8fd2-cae0-463a-9257-94661d3ca042 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:34:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3eac8fd2-cae0-463a-9257-94661d3ca042 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:34:33 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-3eac8fd2-cae0-463a-9257-94661d3ca042 tempest-ProjectMemberTests-1041831846 None] Creating offline snapshot e1a5480c-d032-4b1a-b02b-dd4d0d125fab of volume 47efa002-677c-4574-b6fd-97ebb54f361b {{(pid=87399) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 18:34:33 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e03f1a-e184-4713-b252-ef3e190172b0]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:34:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3eac8fd2-cae0-463a-9257-94661d3ca042 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:33 devstack sudo[107873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b Jul 10 18:34:33 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:33 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3eac8fd2-cae0-463a-9257-94661d3ca042 tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b" returned: 0 in 0.754s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:33 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3eac8fd2-cae0-463a-9257-94661d3ca042 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b.e1a5480c-d032-4b1a-b02b-dd4d0d125fab 1G {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:33 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b.e1a5480c-d032-4b1a-b02b-dd4d0d125fab 1G Jul 10 18:34:33 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:34 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3eac8fd2-cae0-463a-9257-94661d3ca042 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b.e1a5480c-d032-4b1a-b02b-dd4d0d125fab 1G" returned: 0 in 0.789s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:34 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3eac8fd2-cae0-463a-9257-94661d3ca042 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47efa002-677c-4574-b6fd-97ebb54f361b -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b.e1a5480c-d032-4b1a-b02b-dd4d0d125fab {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:34 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47efa002-677c-4574-b6fd-97ebb54f361b -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b.e1a5480c-d032-4b1a-b02b-dd4d0d125fab Jul 10 18:34:34 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:35 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3eac8fd2-cae0-463a-9257-94661d3ca042 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47efa002-677c-4574-b6fd-97ebb54f361b -F qcow2 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b.e1a5480c-d032-4b1a-b02b-dd4d0d125fab" returned: 0 in 0.712s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:35 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-3eac8fd2-cae0-463a-9257-94661d3ca042 tempest-ProjectMemberTests-1041831846 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b.e1a5480c-d032-4b1a-b02b-dd4d0d125fab is being set with open permissions: ugo+rw Jul 10 18:34:35 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3eac8fd2-cae0-463a-9257-94661d3ca042 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b.e1a5480c-d032-4b1a-b02b-dd4d0d125fab {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:35 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b.e1a5480c-d032-4b1a-b02b-dd4d0d125fab Jul 10 18:34:35 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:36 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3eac8fd2-cae0-463a-9257-94661d3ca042 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b.e1a5480c-d032-4b1a-b02b-dd4d0d125fab" returned: 0 in 0.639s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3eac8fd2-cae0-463a-9257-94661d3ca042 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:36 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b.info Jul 10 18:34:36 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:36 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3eac8fd2-cae0-463a-9257-94661d3ca042 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b.info" returned: 0 in 0.652s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:36 devstack cinder-volume[87399]: WARNING cinder.volume.drivers.remotefs [None req-3eac8fd2-cae0-463a-9257-94661d3ca042 tempest-ProjectMemberTests-1041831846 None] /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b.info is being set with open permissions: ugo+rw Jul 10 18:34:36 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3eac8fd2-cae0-463a-9257-94661d3ca042 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b.info {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:36 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b.info Jul 10 18:34:36 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:37 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-3eac8fd2-cae0-463a-9257-94661d3ca042 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b.info" returned: 0 in 0.649s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:37 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-3eac8fd2-cae0-463a-9257-94661d3ca042 tempest-ProjectMemberTests-1041831846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.271s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:34:37 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-3eac8fd2-cae0-463a-9257-94661d3ca042 tempest-ProjectMemberTests-1041831846 None] Create snapshot completed successfully Jul 10 18:34:38 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-26c98c02-dbf9-466b-a023-2fff787f9aa0 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-e1a5480c-d032-4b1a-b02b-dd4d0d125fab-delete_snapshot" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:34:38 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-26c98c02-dbf9-466b-a023-2fff787f9aa0 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-e1a5480c-d032-4b1a-b02b-dd4d0d125fab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:34:38 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-26c98c02-dbf9-466b-a023-2fff787f9aa0 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-quobyte-47efa002-677c-4574-b6fd-97ebb54f361b" by "delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:34:38 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-26c98c02-dbf9-466b-a023-2fff787f9aa0 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-47efa002-677c-4574-b6fd-97ebb54f361b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:34:38 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-26c98c02-dbf9-466b-a023-2fff787f9aa0 tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-quobyte-e1a5480c-d032-4b1a-b02b-dd4d0d125fab" by "_delete_snapshot" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:34:38 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-26c98c02-dbf9-466b-a023-2fff787f9aa0 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-e1a5480c-d032-4b1a-b02b-dd4d0d125fab" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:34:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-26c98c02-dbf9-466b-a023-2fff787f9aa0 tempest-ProjectMemberTests-1041831846 None] Deleting offline snapshot e1a5480c-d032-4b1a-b02b-dd4d0d125fab of volume 47efa002-677c-4574-b6fd-97ebb54f361b {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 18:34:38 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-26c98c02-dbf9-466b-a023-2fff787f9aa0 tempest-ProjectMemberTests-1041831846 None] snapshot_file for this snap is: volume-47efa002-677c-4574-b6fd-97ebb54f361b.e1a5480c-d032-4b1a-b02b-dd4d0d125fab {{(pid=87399) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 18:34:38 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[c354a218-8d23-4250-b46a-12cd33d256fc]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:34:38 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-26c98c02-dbf9-466b-a023-2fff787f9aa0 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b.e1a5480c-d032-4b1a-b02b-dd4d0d125fab {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:38 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b.e1a5480c-d032-4b1a-b02b-dd4d0d125fab Jul 10 18:34:38 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:39 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-26c98c02-dbf9-466b-a023-2fff787f9aa0 tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b.e1a5480c-d032-4b1a-b02b-dd4d0d125fab" returned: 0 in 0.739s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:39 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-26c98c02-dbf9-466b-a023-2fff787f9aa0 tempest-ProjectMemberTests-1041831846 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47efa002-677c-4574-b6fd-97ebb54f361b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87399) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 18:34:39 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fbaf04-54b6-46f3-951f-5ebebc1d6c9e]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:34:39 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-26c98c02-dbf9-466b-a023-2fff787f9aa0 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:39 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b Jul 10 18:34:39 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:40 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-26c98c02-dbf9-466b-a023-2fff787f9aa0 tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b" returned: 0 in 0.728s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-26c98c02-dbf9-466b-a023-2fff787f9aa0 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b.e1a5480c-d032-4b1a-b02b-dd4d0d125fab {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:40 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b.e1a5480c-d032-4b1a-b02b-dd4d0d125fab Jul 10 18:34:40 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:40 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-26c98c02-dbf9-466b-a023-2fff787f9aa0 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b.e1a5480c-d032-4b1a-b02b-dd4d0d125fab" returned: 0 in 0.738s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:40 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-26c98c02-dbf9-466b-a023-2fff787f9aa0 tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b.e1a5480c-d032-4b1a-b02b-dd4d0d125fab {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:40 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b.e1a5480c-d032-4b1a-b02b-dd4d0d125fab Jul 10 18:34:40 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:41 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-26c98c02-dbf9-466b-a023-2fff787f9aa0 tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b.e1a5480c-d032-4b1a-b02b-dd4d0d125fab" returned: 0 in 0.639s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:41 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-26c98c02-dbf9-466b-a023-2fff787f9aa0 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-e1a5480c-d032-4b1a-b02b-dd4d0d125fab" released by "_delete_snapshot" :: held 2.934s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:34:41 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-26c98c02-dbf9-466b-a023-2fff787f9aa0 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-47efa002-677c-4574-b6fd-97ebb54f361b" released by "delete_snapshot" :: held 2.954s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:34:41 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-26c98c02-dbf9-466b-a023-2fff787f9aa0 tempest-ProjectMemberTests-1041831846 None] Created reservations ['13207dbc-c960-4298-95e8-e7466ecafa92', 'd56d9541-c355-481e-a6e5-4c1eeafae752', '3c0ab8c5-011d-4d25-b97a-a78f7e34e1fa', 'b480dc96-430b-401f-81be-f7dc2bee2836'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:34:41 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-26c98c02-dbf9-466b-a023-2fff787f9aa0 tempest-ProjectMemberTests-1041831846 None] Delete snapshot completed successfully. Jul 10 18:34:41 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-26c98c02-dbf9-466b-a023-2fff787f9aa0 tempest-ProjectMemberTests-1041831846 None] Lock "cinder-e1a5480c-d032-4b1a-b02b-dd4d0d125fab-delete_snapshot" released by "delete_snapshot" :: held 3.090s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:34:41 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-9961b676-b286-442f-b013-f8315e59a7ba tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-47efa002-677c-4574-b6fd-97ebb54f361b-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:34:41 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-9961b676-b286-442f-b013-f8315e59a7ba tempest-ProjectMemberTests-1041831846 None] Lock "cinder-47efa002-677c-4574-b6fd-97ebb54f361b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:34:41 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-9961b676-b286-442f-b013-f8315e59a7ba tempest-ProjectMemberTests-1041831846 None] Acquiring lock "cinder-quobyte-47efa002-677c-4574-b6fd-97ebb54f361b" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:34:41 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-9961b676-b286-442f-b013-f8315e59a7ba tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-47efa002-677c-4574-b6fd-97ebb54f361b" acquired by "delete_volume" :: waited 0.017s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:34:41 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[addf2d2e-9398-4109-a498-3b5d5a6d86bb]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:34:41 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9961b676-b286-442f-b013-f8315e59a7ba tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:41 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b Jul 10 18:34:41 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:42 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9961b676-b286-442f-b013-f8315e59a7ba tempest-ProjectMemberTests-1041831846 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b" returned: 0 in 0.739s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:42 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9961b676-b286-442f-b013-f8315e59a7ba tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:42 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b Jul 10 18:34:42 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:43 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9961b676-b286-442f-b013-f8315e59a7ba tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-47efa002-677c-4574-b6fd-97ebb54f361b" returned: 0 in 0.649s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:43 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-9961b676-b286-442f-b013-f8315e59a7ba tempest-ProjectMemberTests-1041831846 None] Lock "cinder-quobyte-47efa002-677c-4574-b6fd-97ebb54f361b" released by "delete_volume" :: held 1.449s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:34:43 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-9961b676-b286-442f-b013-f8315e59a7ba tempest-ProjectMemberTests-1041831846 None] Created reservations ['2696ed65-815c-4e5b-a44a-0c2663f266fa', '52cb487a-440e-4ca8-8ebd-3b00b594d8f7', 'bacb85a4-d8cb-4842-a787-92fed8013441', '77b856d4-3fdf-4152-b17c-b7c9d1226946'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:34:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9961b676-b286-442f-b013-f8315e59a7ba tempest-ProjectMemberTests-1041831846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:34:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9961b676-b286-442f-b013-f8315e59a7ba tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:34:43 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9961b676-b286-442f-b013-f8315e59a7ba tempest-ProjectMemberTests-1041831846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:34:43 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9961b676-b286-442f-b013-f8315e59a7ba tempest-ProjectMemberTests-1041831846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:34:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9961b676-b286-442f-b013-f8315e59a7ba tempest-ProjectMemberTests-1041831846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:34:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9961b676-b286-442f-b013-f8315e59a7ba tempest-ProjectMemberTests-1041831846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:43 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:34:43 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:43 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:43 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9961b676-b286-442f-b013-f8315e59a7ba tempest-ProjectMemberTests-1041831846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.677s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:43 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-9961b676-b286-442f-b013-f8315e59a7ba tempest-ProjectMemberTests-1041831846 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:34:43 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-9961b676-b286-442f-b013-f8315e59a7ba tempest-ProjectMemberTests-1041831846 None] Deleted volume successfully. Jul 10 18:34:43 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-9961b676-b286-442f-b013-f8315e59a7ba tempest-ProjectMemberTests-1041831846 None] Lock "cinder-47efa002-677c-4574-b6fd-97ebb54f361b-delete_volume" released by "delete_volume" :: held 2.322s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:34:53 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:DELETE=6,cinder:UPDATE=78,cinder:SELECT=55,cinder:INSERT=19 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:34:53 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:UPDATE=61,cinder:SELECT=53,cinder:DELETE=7,cinder:INSERT=20 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:34:55 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:34:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] Flow 'volume_create_manager' (aa81755e-5f86-4afa-aad0-d5cdb246e101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:34:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9c4a49-495c-478e-9114-eec95902b152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:34:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa9c4a49-495c-478e-9114-eec95902b152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-433890997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ee78a93-53a7-4c6e-b05e-20772ec6bcec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6839053ab09430b93d7ec7af65a4a1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:34:55Z,use_quota=True,user_id='33f88ea9aa1344c9802856700b37646b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:34:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c91b86-2218-45d4-b506-158ec76395c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:34:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3c91b86-2218-45d4-b506-158ec76395c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:34:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad74f3d4-0e76-4a31-954c-6ab68762d299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:34:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad74f3d4-0e76-4a31-954c-6ab68762d299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ee78a93-53a7-4c6e-b05e-20772ec6bcec', 'volume_name': 'volume-8ee78a93-53a7-4c6e-b05e-20772ec6bcec', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:34:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (649d0316-81cb-4864-8956-b52809c3db7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:34:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (649d0316-81cb-4864-8956-b52809c3db7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:34:55 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c97e840e-4cd6-4ec8-9df8-bd3819ebb5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:34:55 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] Volume 8ee78a93-53a7-4c6e-b05e-20772ec6bcec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ee78a93-53a7-4c6e-b05e-20772ec6bcec', 'volume_size': 1} Jul 10 18:34:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:34:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:34:55 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-433890997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ee78a93-53a7-4c6e-b05e-20772ec6bcec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6839053ab09430b93d7ec7af65a4a1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:34:55Z,use_quota=True,user_id='33f88ea9aa1344c9802856700b37646b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:34:55 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] Creating volume 8ee78a93-53a7-4c6e-b05e-20772ec6bcec {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:34:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:34:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:34:55 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:34:55 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:34:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:34:55 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:34:55 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:34:55 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8ee78a93-53a7-4c6e-b05e-20772ec6bcec 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:55 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8ee78a93-53a7-4c6e-b05e-20772ec6bcec 1073741824 Jul 10 18:34:55 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:56 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8ee78a93-53a7-4c6e-b05e-20772ec6bcec 1073741824" returned: 0 in 0.827s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:56 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8ee78a93-53a7-4c6e-b05e-20772ec6bcec {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:56 devstack sudo[107977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8ee78a93-53a7-4c6e-b05e-20772ec6bcec Jul 10 18:34:56 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:57 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8ee78a93-53a7-4c6e-b05e-20772ec6bcec" returned: 0 in 0.630s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:34:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:34:57 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c97e840e-4cd6-4ec8-9df8-bd3819ebb5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ee78a93-53a7-4c6e-b05e-20772ec6bcec', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:34:57 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c4060c-22f6-4fb7-8a97-05eeefdd4122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:34:57 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] Volume volume-8ee78a93-53a7-4c6e-b05e-20772ec6bcec (8ee78a93-53a7-4c6e-b05e-20772ec6bcec): created successfully Jul 10 18:34:57 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9c4060c-22f6-4fb7-8a97-05eeefdd4122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:34:57 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] Flow 'volume_create_manager' (aa81755e-5f86-4afa-aad0-d5cdb246e101) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:34:57 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-bb338507-711e-44cf-aef6-69a53678bc2b tempest-ProjectReaderTests-606130505 None] Created volume successfully. Jul 10 18:34:57 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:34:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:34:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:34:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:34:57 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:34:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:34:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:57 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:34:57 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7cdf6067-7137-41c8-b078-8e927404a167 tempest-ProjectReaderTests-606130505 None] Acquiring lock "cinder-8ee78a93-53a7-4c6e-b05e-20772ec6bcec-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:34:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7cdf6067-7137-41c8-b078-8e927404a167 tempest-ProjectReaderTests-606130505 None] Lock "cinder-8ee78a93-53a7-4c6e-b05e-20772ec6bcec-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:34:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7cdf6067-7137-41c8-b078-8e927404a167 tempest-ProjectReaderTests-606130505 None] Acquiring lock "cinder-quobyte-8ee78a93-53a7-4c6e-b05e-20772ec6bcec" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:34:57 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7cdf6067-7137-41c8-b078-8e927404a167 tempest-ProjectReaderTests-606130505 None] Lock "cinder-quobyte-8ee78a93-53a7-4c6e-b05e-20772ec6bcec" acquired by "delete_volume" :: waited 0.016s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:34:57 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68c3911-94df-413b-a23d-09a057e9a732]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:34:57 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7cdf6067-7137-41c8-b078-8e927404a167 tempest-ProjectReaderTests-606130505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8ee78a93-53a7-4c6e-b05e-20772ec6bcec {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:57 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8ee78a93-53a7-4c6e-b05e-20772ec6bcec Jul 10 18:34:57 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:58 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.642s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:58 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:34:58 devstack cinder-volume[87399]: DEBUG oslo_service.periodic_task [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] Running periodic task VolumeManager._thread_info {{(pid=87399) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 18:34:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread count: 28 {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 18:34:58 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-1817b886-a7b7-4d19-8153-e71b617d8b2e None None] thread info: [<_MainThread(MainThread, started 139757428633728)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87399) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 18:34:58 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7cdf6067-7137-41c8-b078-8e927404a167 tempest-ProjectReaderTests-606130505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8ee78a93-53a7-4c6e-b05e-20772ec6bcec" returned: 0 in 0.791s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:58 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7cdf6067-7137-41c8-b078-8e927404a167 tempest-ProjectReaderTests-606130505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8ee78a93-53a7-4c6e-b05e-20772ec6bcec {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:58 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8ee78a93-53a7-4c6e-b05e-20772ec6bcec Jul 10 18:34:58 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:34:59 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Jul 10 18:34:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7cdf6067-7137-41c8-b078-8e927404a167 tempest-ProjectReaderTests-606130505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-8ee78a93-53a7-4c6e-b05e-20772ec6bcec" returned: 0 in 0.678s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:34:59 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7cdf6067-7137-41c8-b078-8e927404a167 tempest-ProjectReaderTests-606130505 None] Lock "cinder-quobyte-8ee78a93-53a7-4c6e-b05e-20772ec6bcec" released by "delete_volume" :: held 1.518s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:34:59 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-7cdf6067-7137-41c8-b078-8e927404a167 tempest-ProjectReaderTests-606130505 None] Created reservations ['ce5b954e-c5e4-4b9c-92e8-5d741ffe885a', 'c32c70a5-6def-4333-8669-bf2a9d6a30d4', 'cde431ab-3d4c-4110-9141-84b8b5338b70', 'e540b2aa-aade-4fa7-bf8f-281308810618'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:34:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7cdf6067-7137-41c8-b078-8e927404a167 tempest-ProjectReaderTests-606130505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:34:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7cdf6067-7137-41c8-b078-8e927404a167 tempest-ProjectReaderTests-606130505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:34:59 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7cdf6067-7137-41c8-b078-8e927404a167 tempest-ProjectReaderTests-606130505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:34:59 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-7cdf6067-7137-41c8-b078-8e927404a167 tempest-ProjectReaderTests-606130505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:34:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-7cdf6067-7137-41c8-b078-8e927404a167 tempest-ProjectReaderTests-606130505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:34:59 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7cdf6067-7137-41c8-b078-8e927404a167 tempest-ProjectReaderTests-606130505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:34:59 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:34:59 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:35:00 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Jul 10 18:35:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-7cdf6067-7137-41c8-b078-8e927404a167 tempest-ProjectReaderTests-606130505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.644s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:35:00 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-7cdf6067-7137-41c8-b078-8e927404a167 tempest-ProjectReaderTests-606130505 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:35:00 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-7cdf6067-7137-41c8-b078-8e927404a167 tempest-ProjectReaderTests-606130505 None] Deleted volume successfully. Jul 10 18:35:00 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-7cdf6067-7137-41c8-b078-8e927404a167 tempest-ProjectReaderTests-606130505 None] Lock "cinder-8ee78a93-53a7-4c6e-b05e-20772ec6bcec-delete_volume" released by "delete_volume" :: held 2.361s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:35:00 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:35:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] Flow 'volume_create_manager' (9e26fdb4-99a7-4db3-b77f-f273c92a478a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:35:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a27ca9f-5c73-4fdb-beff-b36f239bd32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:35:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a27ca9f-5c73-4fdb-beff-b36f239bd32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2079708319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda37b5c-e3ef-4fa5-91fb-90466d1fb792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6839053ab09430b93d7ec7af65a4a1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:35:00Z,use_quota=True,user_id='33f88ea9aa1344c9802856700b37646b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:35:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (679327ce-78b3-48fe-bd6f-f821b073b408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:35:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (679327ce-78b3-48fe-bd6f-f821b073b408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:35:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17f57acb-ebe2-49bc-9bcf-b223d311f549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:35:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17f57acb-ebe2-49bc-9bcf-b223d311f549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fda37b5c-e3ef-4fa5-91fb-90466d1fb792', 'volume_name': 'volume-fda37b5c-e3ef-4fa5-91fb-90466d1fb792', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:35:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97eb040-adf9-4dd3-bfbc-07bc5d685629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:35:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97eb040-adf9-4dd3-bfbc-07bc5d685629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:35:00 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (986adc2f-cc0e-44bd-805b-e746ff0081ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:35:00 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] Volume fda37b5c-e3ef-4fa5-91fb-90466d1fb792: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fda37b5c-e3ef-4fa5-91fb-90466d1fb792', 'volume_size': 1} Jul 10 18:35:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:35:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:35:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2079708319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda37b5c-e3ef-4fa5-91fb-90466d1fb792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6839053ab09430b93d7ec7af65a4a1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:35:00Z,use_quota=True,user_id='33f88ea9aa1344c9802856700b37646b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:35:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] Creating volume fda37b5c-e3ef-4fa5-91fb-90466d1fb792 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:35:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:35:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:35:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:35:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:35:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:35:00 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:35:00 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:35:00 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fda37b5c-e3ef-4fa5-91fb-90466d1fb792 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:35:00 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fda37b5c-e3ef-4fa5-91fb-90466d1fb792 1073741824 Jul 10 18:35:00 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:35:01 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Jul 10 18:35:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fda37b5c-e3ef-4fa5-91fb-90466d1fb792 1073741824" returned: 0 in 0.832s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:35:01 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fda37b5c-e3ef-4fa5-91fb-90466d1fb792 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:35:01 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fda37b5c-e3ef-4fa5-91fb-90466d1fb792 Jul 10 18:35:01 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:35:02 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Jul 10 18:35:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fda37b5c-e3ef-4fa5-91fb-90466d1fb792" returned: 0 in 0.659s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:35:02 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:35:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:35:02 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (986adc2f-cc0e-44bd-805b-e746ff0081ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fda37b5c-e3ef-4fa5-91fb-90466d1fb792', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:35:02 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4233fd3-446d-45dd-8333-57fbe5222e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:35:02 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] Volume volume-fda37b5c-e3ef-4fa5-91fb-90466d1fb792 (fda37b5c-e3ef-4fa5-91fb-90466d1fb792): created successfully Jul 10 18:35:02 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4233fd3-446d-45dd-8333-57fbe5222e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:35:02 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] Flow 'volume_create_manager' (9e26fdb4-99a7-4db3-b77f-f273c92a478a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:35:02 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-a282f19a-1712-4157-8b90-a1a24bfbab07 tempest-ProjectReaderTests-606130505 None] Created volume successfully. Jul 10 18:35:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5b11263e-8165-46ca-a713-903342af0e72 tempest-ProjectReaderTests-606130505 None] Acquiring lock "cinder-fda37b5c-e3ef-4fa5-91fb-90466d1fb792-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:35:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5b11263e-8165-46ca-a713-903342af0e72 tempest-ProjectReaderTests-606130505 None] Lock "cinder-fda37b5c-e3ef-4fa5-91fb-90466d1fb792-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:35:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5b11263e-8165-46ca-a713-903342af0e72 tempest-ProjectReaderTests-606130505 None] Acquiring lock "cinder-quobyte-fda37b5c-e3ef-4fa5-91fb-90466d1fb792" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:35:02 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5b11263e-8165-46ca-a713-903342af0e72 tempest-ProjectReaderTests-606130505 None] Lock "cinder-quobyte-fda37b5c-e3ef-4fa5-91fb-90466d1fb792" acquired by "delete_volume" :: waited 0.019s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:35:02 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb720e4-4ad9-429b-9259-bdf2fa14bee6]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:35:02 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5b11263e-8165-46ca-a713-903342af0e72 tempest-ProjectReaderTests-606130505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fda37b5c-e3ef-4fa5-91fb-90466d1fb792 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:35:02 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fda37b5c-e3ef-4fa5-91fb-90466d1fb792 Jul 10 18:35:02 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:35:03 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Jul 10 18:35:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5b11263e-8165-46ca-a713-903342af0e72 tempest-ProjectReaderTests-606130505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fda37b5c-e3ef-4fa5-91fb-90466d1fb792" returned: 0 in 0.746s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:35:03 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5b11263e-8165-46ca-a713-903342af0e72 tempest-ProjectReaderTests-606130505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fda37b5c-e3ef-4fa5-91fb-90466d1fb792 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:35:03 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fda37b5c-e3ef-4fa5-91fb-90466d1fb792 Jul 10 18:35:03 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:35:04 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Jul 10 18:35:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5b11263e-8165-46ca-a713-903342af0e72 tempest-ProjectReaderTests-606130505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-fda37b5c-e3ef-4fa5-91fb-90466d1fb792" returned: 0 in 0.639s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:35:04 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5b11263e-8165-46ca-a713-903342af0e72 tempest-ProjectReaderTests-606130505 None] Lock "cinder-quobyte-fda37b5c-e3ef-4fa5-91fb-90466d1fb792" released by "delete_volume" :: held 1.424s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:35:04 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-5b11263e-8165-46ca-a713-903342af0e72 tempest-ProjectReaderTests-606130505 None] Created reservations ['0f3988b3-9cea-4237-8703-96e2363631c1', 'f1da1b47-a47f-4b6d-a1e5-0c6bbccc2b86', 'd0f658db-192f-4dd3-8ca7-0819408203ff', '6f347d2a-f52b-45b9-baa2-733c642263b6'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:35:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5b11263e-8165-46ca-a713-903342af0e72 tempest-ProjectReaderTests-606130505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:35:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5b11263e-8165-46ca-a713-903342af0e72 tempest-ProjectReaderTests-606130505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:35:04 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5b11263e-8165-46ca-a713-903342af0e72 tempest-ProjectReaderTests-606130505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:35:04 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-5b11263e-8165-46ca-a713-903342af0e72 tempest-ProjectReaderTests-606130505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:35:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-5b11263e-8165-46ca-a713-903342af0e72 tempest-ProjectReaderTests-606130505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:35:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5b11263e-8165-46ca-a713-903342af0e72 tempest-ProjectReaderTests-606130505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:35:04 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:35:04 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:35:04 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Jul 10 18:35:04 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-5b11263e-8165-46ca-a713-903342af0e72 tempest-ProjectReaderTests-606130505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.656s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:35:04 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-5b11263e-8165-46ca-a713-903342af0e72 tempest-ProjectReaderTests-606130505 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:35:04 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-5b11263e-8165-46ca-a713-903342af0e72 tempest-ProjectReaderTests-606130505 None] Deleted volume successfully. Jul 10 18:35:04 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-5b11263e-8165-46ca-a713-903342af0e72 tempest-ProjectReaderTests-606130505 None] Lock "cinder-fda37b5c-e3ef-4fa5-91fb-90466d1fb792-delete_volume" released by "delete_volume" :: held 2.304s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:35:05 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:35:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] Flow 'volume_create_manager' (05cbdad5-2f75-4a08-a179-3b2c61c4b5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:35:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6368ad3f-e7d3-45ce-8d4d-fab3c8ca21b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:35:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6368ad3f-e7d3-45ce-8d4d-fab3c8ca21b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1204469216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79107ed0-3d0d-48fa-b24e-203e770394ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6839053ab09430b93d7ec7af65a4a1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:35:05Z,use_quota=True,user_id='33f88ea9aa1344c9802856700b37646b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:35:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d349469-1e18-413a-a0b8-6d751b74f1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:35:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d349469-1e18-413a-a0b8-6d751b74f1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:35:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f212508-5b53-44a0-9c02-2666acf1848f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:35:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f212508-5b53-44a0-9c02-2666acf1848f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79107ed0-3d0d-48fa-b24e-203e770394ff', 'volume_name': 'volume-79107ed0-3d0d-48fa-b24e-203e770394ff', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:35:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (501ee8ee-f44c-4cdb-8f04-4bd1e6fd2168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:35:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (501ee8ee-f44c-4cdb-8f04-4bd1e6fd2168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:35:05 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07ffbbad-0a5e-4a34-932a-17114d7ed60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:35:05 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] Volume 79107ed0-3d0d-48fa-b24e-203e770394ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79107ed0-3d0d-48fa-b24e-203e770394ff', 'volume_size': 1} Jul 10 18:35:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:35:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:35:05 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1204469216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79107ed0-3d0d-48fa-b24e-203e770394ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6839053ab09430b93d7ec7af65a4a1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:35:05Z,use_quota=True,user_id='33f88ea9aa1344c9802856700b37646b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:35:05 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] Creating volume 79107ed0-3d0d-48fa-b24e-203e770394ff {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:35:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:35:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:35:05 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:35:05 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:35:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:35:05 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:35:05 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:35:05 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-79107ed0-3d0d-48fa-b24e-203e770394ff 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:35:05 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-79107ed0-3d0d-48fa-b24e-203e770394ff 1073741824 Jul 10 18:35:05 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:35:06 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Jul 10 18:35:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-79107ed0-3d0d-48fa-b24e-203e770394ff 1073741824" returned: 0 in 0.788s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:35:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-79107ed0-3d0d-48fa-b24e-203e770394ff {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:35:06 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-79107ed0-3d0d-48fa-b24e-203e770394ff Jul 10 18:35:06 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:35:06 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Jul 10 18:35:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-79107ed0-3d0d-48fa-b24e-203e770394ff" returned: 0 in 0.644s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:35:06 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:35:06 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:35:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07ffbbad-0a5e-4a34-932a-17114d7ed60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79107ed0-3d0d-48fa-b24e-203e770394ff', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:35:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d0b0ef6-cbe0-4a69-af6b-ab96c24980fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:35:06 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] Volume volume-79107ed0-3d0d-48fa-b24e-203e770394ff (79107ed0-3d0d-48fa-b24e-203e770394ff): created successfully Jul 10 18:35:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d0b0ef6-cbe0-4a69-af6b-ab96c24980fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:35:06 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] Flow 'volume_create_manager' (05cbdad5-2f75-4a08-a179-3b2c61c4b5d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:35:06 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-d71961b7-a86e-4a97-934c-859e0d2101ec tempest-ProjectReaderTests-606130505 None] Created volume successfully. Jul 10 18:35:07 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ab9548f9-409b-48d3-9c7a-ba1e87549892 tempest-ProjectReaderTests-606130505 None] Acquiring lock "cinder-79107ed0-3d0d-48fa-b24e-203e770394ff-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:35:07 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ab9548f9-409b-48d3-9c7a-ba1e87549892 tempest-ProjectReaderTests-606130505 None] Lock "cinder-79107ed0-3d0d-48fa-b24e-203e770394ff-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:35:07 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ab9548f9-409b-48d3-9c7a-ba1e87549892 tempest-ProjectReaderTests-606130505 None] Acquiring lock "cinder-quobyte-79107ed0-3d0d-48fa-b24e-203e770394ff" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:35:07 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ab9548f9-409b-48d3-9c7a-ba1e87549892 tempest-ProjectReaderTests-606130505 None] Lock "cinder-quobyte-79107ed0-3d0d-48fa-b24e-203e770394ff" acquired by "delete_volume" :: waited 0.014s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:35:07 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d367d22-bc93-46b3-96fe-7cbc7da64c8e]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:35:07 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ab9548f9-409b-48d3-9c7a-ba1e87549892 tempest-ProjectReaderTests-606130505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-79107ed0-3d0d-48fa-b24e-203e770394ff {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:35:07 devstack sudo[108033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-79107ed0-3d0d-48fa-b24e-203e770394ff Jul 10 18:35:07 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:35:08 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root Jul 10 18:35:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ab9548f9-409b-48d3-9c7a-ba1e87549892 tempest-ProjectReaderTests-606130505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-79107ed0-3d0d-48fa-b24e-203e770394ff" returned: 0 in 0.754s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:35:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ab9548f9-409b-48d3-9c7a-ba1e87549892 tempest-ProjectReaderTests-606130505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-79107ed0-3d0d-48fa-b24e-203e770394ff {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:35:08 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-79107ed0-3d0d-48fa-b24e-203e770394ff Jul 10 18:35:08 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:35:08 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Jul 10 18:35:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ab9548f9-409b-48d3-9c7a-ba1e87549892 tempest-ProjectReaderTests-606130505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-79107ed0-3d0d-48fa-b24e-203e770394ff" returned: 0 in 0.629s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:35:08 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ab9548f9-409b-48d3-9c7a-ba1e87549892 tempest-ProjectReaderTests-606130505 None] Lock "cinder-quobyte-79107ed0-3d0d-48fa-b24e-203e770394ff" released by "delete_volume" :: held 1.423s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:35:08 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-ab9548f9-409b-48d3-9c7a-ba1e87549892 tempest-ProjectReaderTests-606130505 None] Created reservations ['383638f7-aba8-414c-8e99-e33eebdde7c5', 'f2bdd114-53fc-4a7e-92a4-3dae190cb125', '2cb8d910-2f41-43d4-85a3-a862516ab4ce', 'dc13a3f8-aef3-4d59-80f0-fba95649ce1a'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:35:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ab9548f9-409b-48d3-9c7a-ba1e87549892 tempest-ProjectReaderTests-606130505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:35:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ab9548f9-409b-48d3-9c7a-ba1e87549892 tempest-ProjectReaderTests-606130505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:35:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ab9548f9-409b-48d3-9c7a-ba1e87549892 tempest-ProjectReaderTests-606130505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:35:08 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-ab9548f9-409b-48d3-9c7a-ba1e87549892 tempest-ProjectReaderTests-606130505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:35:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-ab9548f9-409b-48d3-9c7a-ba1e87549892 tempest-ProjectReaderTests-606130505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:35:08 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ab9548f9-409b-48d3-9c7a-ba1e87549892 tempest-ProjectReaderTests-606130505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:35:08 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:35:08 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:35:09 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Jul 10 18:35:09 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-ab9548f9-409b-48d3-9c7a-ba1e87549892 tempest-ProjectReaderTests-606130505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.636s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:35:09 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-ab9548f9-409b-48d3-9c7a-ba1e87549892 tempest-ProjectReaderTests-606130505 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:35:09 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-ab9548f9-409b-48d3-9c7a-ba1e87549892 tempest-ProjectReaderTests-606130505 None] Deleted volume successfully. Jul 10 18:35:09 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-ab9548f9-409b-48d3-9c7a-ba1e87549892 tempest-ProjectReaderTests-606130505 None] Lock "cinder-79107ed0-3d0d-48fa-b24e-203e770394ff-delete_volume" released by "delete_volume" :: held 2.248s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:35:09 devstack cinder-volume[87399]: DEBUG cinder.volume.flows.manager.create_volume [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87399) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 18:35:09 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] Flow 'volume_create_manager' (8b2a9d47-fb51-4b1d-a3f9-255645ea8d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:35:09 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed2299b5-e9c5-453a-acc7-75aaafea0780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:35:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed2299b5-e9c5-453a-acc7-75aaafea0780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-787005442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bd064b9-5857-41df-8191-2cc8a0729917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6839053ab09430b93d7ec7af65a4a1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:35:10Z,use_quota=True,user_id='33f88ea9aa1344c9802856700b37646b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:35:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f826c9bf-070f-4291-abb3-f40fb68f751f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:35:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f826c9bf-070f-4291-abb3-f40fb68f751f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:35:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aade22a2-2e19-4621-b68f-08344f990bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:35:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aade22a2-2e19-4621-b68f-08344f990bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bd064b9-5857-41df-8191-2cc8a0729917', 'volume_name': 'volume-2bd064b9-5857-41df-8191-2cc8a0729917', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:35:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a5635c-bdf6-4fca-bc58-c3f8a4be0f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:35:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a5635c-bdf6-4fca-bc58-c3f8a4be0f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:35:10 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603eb8d9-eee9-4c9b-a24a-a6c48913958a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:35:10 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] Volume 2bd064b9-5857-41df-8191-2cc8a0729917: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bd064b9-5857-41df-8191-2cc8a0729917', 'volume_size': 1} Jul 10 18:35:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:35:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:35:10 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T16:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-787005442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bd064b9-5857-41df-8191-2cc8a0729917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6839053ab09430b93d7ec7af65a4a1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T16:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T16:35:10Z,use_quota=True,user_id='33f88ea9aa1344c9802856700b37646b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7eabe13b-37c0-4987-977e-745facb0d659),volume_type_id=7eabe13b-37c0-4987-977e-745facb0d659)}" {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 18:35:10 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.remotefs [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] Creating volume 2bd064b9-5857-41df-8191-2cc8a0729917 {{(pid=87399) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 18:35:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:35:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:35:10 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:35:10 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:35:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:35:10 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] Selected osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd as target Quobyte volume. {{(pid=87399) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 18:35:10 devstack cinder-volume[87399]: INFO cinder.volume.drivers.remotefs [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] casted to osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd Jul 10 18:35:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2bd064b9-5857-41df-8191-2cc8a0729917 1073741824 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:35:10 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2bd064b9-5857-41df-8191-2cc8a0729917 1073741824 Jul 10 18:35:10 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:35:10 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Jul 10 18:35:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2bd064b9-5857-41df-8191-2cc8a0729917 1073741824" returned: 0 in 0.816s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:35:10 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2bd064b9-5857-41df-8191-2cc8a0729917 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:35:10 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2bd064b9-5857-41df-8191-2cc8a0729917 Jul 10 18:35:10 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:35:11 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Jul 10 18:35:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2bd064b9-5857-41df-8191-2cc8a0729917" returned: 0 in 0.658s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:35:11 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'} {{(pid=87399) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 18:35:11 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:35:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603eb8d9-eee9-4c9b-a24a-a6c48913958a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bd064b9-5857-41df-8191-2cc8a0729917', 'volume_size': 1}' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:35:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6258e60-8771-4ec8-afeb-a63b123f59aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 18:35:11 devstack cinder-volume[87399]: INFO cinder.volume.flows.manager.create_volume [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] Volume volume-2bd064b9-5857-41df-8191-2cc8a0729917 (2bd064b9-5857-41df-8191-2cc8a0729917): created successfully Jul 10 18:35:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6258e60-8771-4ec8-afeb-a63b123f59aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87399) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 18:35:11 devstack cinder-volume[87399]: DEBUG cinder.volume.manager [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] Flow 'volume_create_manager' (8b2a9d47-fb51-4b1d-a3f9-255645ea8d60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87399) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 18:35:11 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-9482ec45-98eb-40c3-9c06-04126cefb50e tempest-ProjectReaderTests-606130505 None] Created volume successfully. Jul 10 18:35:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e69b612a-5c07-4816-b527-e9033cfa0cb7 tempest-ProjectReaderTests-606130505 None] Acquiring lock "cinder-2bd064b9-5857-41df-8191-2cc8a0729917-delete_volume" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:35:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e69b612a-5c07-4816-b527-e9033cfa0cb7 tempest-ProjectReaderTests-606130505 None] Lock "cinder-2bd064b9-5857-41df-8191-2cc8a0729917-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:35:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e69b612a-5c07-4816-b527-e9033cfa0cb7 tempest-ProjectReaderTests-606130505 None] Acquiring lock "cinder-quobyte-2bd064b9-5857-41df-8191-2cc8a0729917" by "delete_volume" {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 18:35:12 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e69b612a-5c07-4816-b527-e9033cfa0cb7 tempest-ProjectReaderTests-606130505 None] Lock "cinder-quobyte-2bd064b9-5857-41df-8191-2cc8a0729917" acquired by "delete_volume" :: waited 0.015s {{(pid=87399) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 18:35:12 devstack cinder-volume[87399]: DEBUG oslo.privsep.daemon [-] privsep: reply[49941ac0-3ca9-4814-841c-9c59f1288d01]: (4, 'qcow2') {{(pid=88393) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 18:35:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e69b612a-5c07-4816-b527-e9033cfa0cb7 tempest-ProjectReaderTests-606130505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2bd064b9-5857-41df-8191-2cc8a0729917 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:35:12 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2bd064b9-5857-41df-8191-2cc8a0729917 Jul 10 18:35:12 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:35:12 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Jul 10 18:35:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e69b612a-5c07-4816-b527-e9033cfa0cb7 tempest-ProjectReaderTests-606130505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2bd064b9-5857-41df-8191-2cc8a0729917" returned: 0 in 0.783s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:35:12 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e69b612a-5c07-4816-b527-e9033cfa0cb7 tempest-ProjectReaderTests-606130505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2bd064b9-5857-41df-8191-2cc8a0729917 {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:35:12 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2bd064b9-5857-41df-8191-2cc8a0729917 Jul 10 18:35:12 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:35:13 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Jul 10 18:35:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e69b612a-5c07-4816-b527-e9033cfa0cb7 tempest-ProjectReaderTests-606130505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e/volume-2bd064b9-5857-41df-8191-2cc8a0729917" returned: 0 in 0.646s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:35:13 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e69b612a-5c07-4816-b527-e9033cfa0cb7 tempest-ProjectReaderTests-606130505 None] Lock "cinder-quobyte-2bd064b9-5857-41df-8191-2cc8a0729917" released by "delete_volume" :: held 1.467s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:35:13 devstack cinder-volume[87399]: DEBUG cinder.quota [None req-e69b612a-5c07-4816-b527-e9033cfa0cb7 tempest-ProjectReaderTests-606130505 None] Created reservations ['50c42f55-70d5-4193-aae0-69c61d9d24f5', '7a1cd9af-a47e-4596-8ecb-17d2b9dfc158', 'dbee4e2e-9896-427d-b85a-916c32bef74a', 'f27d953e-4dbe-4169-96cf-59e447f59c9f'] {{(pid=87399) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 18:35:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e69b612a-5c07-4816-b527-e9033cfa0cb7 tempest-ProjectReaderTests-606130505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 18:35:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e69b612a-5c07-4816-b527-e9033cfa0cb7 tempest-ProjectReaderTests-606130505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 18:35:13 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e69b612a-5c07-4816-b527-e9033cfa0cb7 tempest-ProjectReaderTests-606130505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd': None} {{(pid=87399) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 18:35:13 devstack cinder-volume[87399]: DEBUG cinder.volume.drivers.quobyte [None req-e69b612a-5c07-4816-b527-e9033cfa0cb7 tempest-ProjectReaderTests-606130505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-acc6a093-df9c-414e-81f9-0e95627c95fd'] {{(pid=87399) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 18:35:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.lockutils [None req-e69b612a-5c07-4816-b527-e9033cfa0cb7 tempest-ProjectReaderTests-606130505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87399) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 18:35:13 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e69b612a-5c07-4816-b527-e9033cfa0cb7 tempest-ProjectReaderTests-606130505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 18:35:13 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e Jul 10 18:35:13 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 18:35:14 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Jul 10 18:35:14 devstack cinder-volume[87399]: DEBUG oslo_concurrency.processutils [None req-e69b612a-5c07-4816-b527-e9033cfa0cb7 tempest-ProjectReaderTests-606130505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/845910845df9b293689967c350e2774e" returned: 0 in 0.654s {{(pid=87399) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 18:35:14 devstack cinder-volume[87399]: DEBUG cinder.manager [None req-e69b612a-5c07-4816-b527-e9033cfa0cb7 tempest-ProjectReaderTests-606130505 None] Notifying Schedulers of capabilities ... {{(pid=87399) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 18:35:14 devstack cinder-volume[87399]: INFO cinder.volume.manager [None req-e69b612a-5c07-4816-b527-e9033cfa0cb7 tempest-ProjectReaderTests-606130505 None] Deleted volume successfully. Jul 10 18:35:14 devstack cinder-volume[87399]: DEBUG cinder.coordination [None req-e69b612a-5c07-4816-b527-e9033cfa0cb7 tempest-ProjectReaderTests-606130505 None] Lock "cinder-2bd064b9-5857-41df-8191-2cc8a0729917-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=87399) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 18:35:30 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:SELECT=29,cinder:UPDATE=48,cinder:DELETE=5,cinder:INSERT=10 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 18:35:30 devstack cinder-volume[87399]: DEBUG dbcounter [-] [87399] Writing DB stats cinder:UPDATE=41,cinder:SELECT=28,cinder:INSERT=10,cinder:DELETE=3 {{(pid=87399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}